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ABSIBACT 

The Panel on Statistics of the Committee on the 
Ondergraduate Program in Mathematics (COPM) prepared this booklet to 
provide guidance to departments of aa the ma tics at small»3r colleges 
and universities on instruction in statistics. Contents include: (1) 
a discussion of the background of the reports and some review of past 
and current approaches to the general introductory course; (2) 
recommended oljectives for the course and a discussion of their 
implications; (3) a detailed description of a conventional course; 
(U) reconmcndations for alternative approaches; (5) suggestions for 
improving the effectiveness of the course; and (6) a selected 
bibliography on teaching statistics. (MP) 
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PREFACE 



The Panel on Statistics of the Conimittec on the Undergrndiintc 
Program In Mathematics (CUPM) was appointed In 1968 to provide guid- 
ance to departments of mathematics at smaller colleges and univer- 
sities on Instruction In statistics. Two concerns of general interest 
were Identified for Initial study by the Panel: a program to prepare 
students for graduate study In statistics and a basic service course 
In Stat .;:lcs for students who have not studied calculus. Tliese two 
topics lepresent currlcular extremes of statistics In most under- 
graduate programs, and many students will need to select a program of 
study that falls between these extremes. In particular, pliyslcal 
scientists, economists, biologists, and well-prepared students In 
other social and life sciences should be made aware of the advantages 
of electing calculus and linear algeoi-a as preparation for a study of 
probability and statistics at a level beyond that described in tills 
report • 

Colleges and universities offer a great variety of courses in 
Introductory statistics with no calculus prerequisite. Courses of 
this kind are frequently offered by several departments witliin a 
single Institution, and therefore this report sliould be of interest 
to Instructors In many departments, nc*. merely to tliose in mathematics 
and statistics. 

Section I contains a discussion of the background of tlie report 
and some review of past and current approaches to Jie general intro- 
ductory course. Section II contains recommended objectives for the 
course and a discussion of their Implications. A conventional course 
is developed In detail in Section III, followed by recommendations for 
alternative approaches in Section IV. Sections V through VII contain 
suggestions for Improving the effectiveness of tl\e course, useful In 
all of the various approaches to it. A selec'-.t^d Bibliography on 
teaching statistics, containing a summary of supplemental references 
as well as additional resource materials, is included at the end of 
the report. 

Ttie Panel is Indebted to many colleagues for their participa- 
tion in a fact-finding conference and for their thoughtful comments 
on a draft version of this repoit. 
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I. INTRODUCTION 



This report Is concerned with a general Introductory statistics 
course without a calculus prerequisite, which Is typically a one- 
semester or one-quarter course offered at tlie sophomore or junior 
level In college. For many students this Is a terminal course, al- 
though some students may elect additional courses In statistics or In 
research methods* In four-year colleges and smaller universities It 
Is often taught by the mathematics department as a service to other 
departmen ts • 

An Introductory statistics course without n ca. cuius prerequl- 
"slte Is often required of students majoring In many different fields, 
such as business administration, psychology, sociology, forestry, and 
Industrial engineering* In odd It Ion, this course serves as an elec- 
tive subject for other students* An understanding of statistical 
concepts Is important for students In any subject where data play an 
important role* Knowledge of basic concepts also permits students to 
use data mo. e effectively In making everyday decisions as clti'.zens 
and consumers, and It might stimulate them to learn more abou: sta- 
tistics In order to obtain the competence needed for research and 
analysis In their major fields of Interest* Some students' Interest 
might even be aroused sufficiently by this Introductory course to 
encourage them to prepare for a program In statistics at the graduate 
level* 

Concern for a noncalculus- based Introductory statistics course 
has been frequently expressed* Many studies have been conducted to 
consider how to make this course a worthwhile, challenging Intellec- 
tual enterprise that provides students with some understanding of 
basic statistical concepts* (See, for Instance, "interim Report of 
the Royal Statistical Society Committee on the Teaching of Statistics 
In Schools." Journal of the Royal Statistical Society . Series A, 
131 (1968), pp* A78-A97.) 

One point of Interest has been the proliferation of introduc- 
tory statistics courses that has taken place on most large .campuoes* 
These courses may differ not only In content but also In vir^phasls and 
method of approach* Some of the factors responsible foi this are the 
desire by different disciplines to have courses tailored to their 
needs, the varying backgrounds of persons teaching statistics, and 
the different objectives for the basic statistics course^ 

Proliferation In Itself Is not necessarily undesirable and 
Indeed may be desirable If Introductory courses directed to specific 
disciplines serve to motivate the basic concepts of statistics more 
effectively or If substantially different objectives are being served. 
However, no widespread satisfaction has been expressed by professional 
statisticians concerning any of the introductory statistics courses 
that have been developed. These courses have been criticized as 
follows : 
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1) Their omphaslB in mathematical or probabilistic without 
providing sufficient insights into statistical conceptB. 

2) They provide Uttle Insight Into the variety and useful- 
ness of the applications of statistics. 

3) They are too technique-oriented, over-emphaslzlng computa- 
tlon and under-emphasizing the fundamental Ideas under- 
lying statistical reasoning. 

4) They give Insufficient attention to drawing statistical 
inferences from real data. 

5) They fall to provide Intellectual stimulation. 

6) They fail to allow for the "symbol shock" Buffered by 
some students. 

7) They provide inadequate motivation for an i"'""'/" 
stochastic (random) models and fail to differentiate ther 
fr™ the deterministic models with which students are mo = 
familiar. 

The discussion and reconrnendations that follow ^"^f '°. 

ine ai-a u criticisms through suggestions on course objec 

ri;;::"a?rrn°a i e" pr^ach^sHur^icufar cfntent. increased motiva- 
tion! ' computer ^'"''-'-S-""'^'' 



II, RECOMMENDED 0HJI2CTIVKS AND THKIR IMI'MCATIONS 



When one conBlderB tin; Viirlcty o'ul jxLimU oI tlic ck'in.uuls for 
an "ideal" first course In statist lea, oiu' rfcov.n I i'.i'iJ llu^ linpcifi- 
slblllEy of having any one course come e*'en cIokp U» llu' Idc-al. Nu 
one courBe can (1) Horv<: as an appreciation coiirsf so that sikitU'iits 
can understand the u.idcrlylnft Ideas of statistical niethodcUcvw and 
statistical Inference, (2) d lac Ip line studcntH lo clUnk quaiUlta- 
tlvely and to appraise data critically, (J) y^lvv students rhe facil- 
ity to analyze data for everyday prol)leTns, triiln students to 
understand probabilistic models and tlielr uses In a variety cif situa- 
tions, and (5) enable students to nuister the basic techniques cif 
statistical methodology and to use tiiese techniques flexibly In tlielr 
own applications. 

Hence, It Is not possible for the Panel to prescribe an Ideal 
Introductory statistics cjarse. The special neetis of the departments 
wlilcli require this course, tlie abilities nnd Interests ot the In- 
structor, and the different cliaracterlsLics of tlie students will In- 
fluence tlie nature of the course, however, tlie following ^ulciellnes 
are recommended by the Panel: 

a, The Introductory statistics course m\ist have limited 
ob iect Ives . Otlierwlse, It Is likely tliat none of tlie objectives 
will be met adequately. 

b , The primary objective of tlie Introduciory stati s tics rou i'^v 
should be to Introduce sttidents to variability and uncertitlnty anr __to 
some common concepts of statistics ; that Is, to methods such as yoinl 
and Interval estimation and hypothesis testing for drawing. Inferences 
and making decisions from observed data, 

c , A secondary objective of the introductory statistics course 
should be to teach the student some common statistical formulas and 
terms and some of the widely used statistical technioues ; e,^., the 
t-test , 

The primary objective may be met in many ways. Much of the 
report considers the conventional introductory course but with a view 
to highlighting desired emphases »ind utiliiiinj; a v.iriety of approaches 
to enhance Interest ind motivation, lit i I i;; at ion of computers, data 
sets, experiments, and demonstrations for greater clarity and motiva- 
tion are discussed. The report also contains suggestions for imple- 
menting the primary objective through less conventional approaches, 
e .g , , nonparamet rlc , dec I s ion-theoret I c . and prob I em- or i en ted 
approaches. The Intent of much of tlie report Is to suggest possible 
Ideas for syllabus and presentation; the instructor must seek that 
combination sulrnd to his needs and those of his students. 
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The Panel recon^ends the primary objective of the in^-^-^^^^ 
ine ranei . ^^ove because an understanding of the 

statistics course, stated above, because intelligent and flex- 

in which they are used. 

2. Tm pUcations nF th^ Reco^nn^nHpH Objectives 

A number of implications follow from the declared objectives. 

a. Since the main objective of the course is ""^^^^^^"^^^8 
K . e^n^^s^ical concepts, it follows that proofs and extensive 

ciples involved. 

c Wl,ile probabilistic concepts are essential for an under- 
standing oT statistical Inference, probability theory should not 
constitute a dominant portion of the course. 

. d In order to illustrat. the application of statistical 
methodology In'^^^Ulng inferences, the course .ust be data-or .ented 
and must incorporate analysis of real-world data. 

Three critical dimensions of the Introductory statistics 

course arr inferential philosophy, mathematics and data analysis. 

Zng these components w^believo rh.r c^ ph^s f ^ ,^ 

.^r^n^lv OP .nfprnnMal ^ nn.Pn^s and dntn analysis, and 
mathematical elements. 

3. RpcommendeH Topics t n be Covered 

= f=,fpH parlier no single introductory statistics 

course embodying the nonparametric approach and 
course utilizing a problem-oriented approach. 

' i3 



statistic. 

as fu^di^^ntal pedagogical tools or are logically essential 
(such as Bayes' Theorem for a Bayesian approach}, 
a. Tn, pnr.«n. toD^^- from Which a select ion should be made 

1 Probability: sample space, mutually exclusive events, 
independent events, conditional probability ""^om 
variable (expected value, variance, standard deviation) 

2. Samples: frequency distribution, histogram °gi^^. P"" 
centiles. mean, median, variance, standard deviation, 
mode, range 

3. Distributions: normal, binomial, Poisson. exponential, 
rectangular, geometric 

A, Sampling theory: Uw of Urge Numbers. Central Limit 
Theorem 

5. Esttaation: point estimates, confidence intervals 

6. Hypothesis testing: alternative and null hypotheses 
power function; errors of types I and II. significance 
levels, one-tail and two-tall tests 

7 One-sample tests: for the mean of a normal distribution 
(t-ter?)! for the proportion of a binomial distribution 

8. Two-sample tests: t-test. Mann-Whitney test, sign test 

9. Chi-square and contingency tables 

10. Regression and correlation 

11. Analysis of variance 

12. Decision theory: minimax and Bayes' strategies, 
admissibility 




ERIC 



Topics to be avoided (except when they serve as useful 
teaching devices) 

1. Combinatorics 

2. Bayes' Theorem 

3. Partial regression 

4. Sequential analysis 

5. MaximuTn likelihood and likeliliood ratio 

6. Compendia of variations of a given procedure 1 e the 
t-tesu 

7. Inferences on variances using clii-square distributions 
(because they involve non-robust procedures) 



III. A CONVENTIONAL COURSE IN INTRODUCTORY STATISTICS 



An approach to the teaching of elementary statistics whose 
popularity is reflected in the most widely used textbooks may bu 
called the conventional approach . It is characterized in part by ci 
logical development in which basic tools are developed slowly and in 
some detail before serious statistical problems are attacked. 

Because of the popularity of the conventional approacli and the 
existence of a wide variety of texts oriented toward this approacli, 
it is the one most likely to be used in two-year and four-year col- 
leges and in smaller universities in the near future. We therefore 
believe it is wise to focus primarily on this kind of course, par- 
ticularly since significant modifications and enrichments can make 
it a worthwhile intellectual experience. 

This traditional approach has potential defects, as noted 
earlier. Typically, the major ideas of statistical inference are 
introduced too late and in haste, and they are often il lustrated by 
examples which are not compelling. Frequenl\y, courses of this kind 
suffer from the Inclusion of irrelevant concepts and excessive mathe- 
matical derivations. Finally, the attempt to break up the subject 
Into small digestible bits may cause the student to miss the unifying 
concepts of statistical inference. The course outline and coitments 
which follow attempt to provide guidance on topics and suggestions 
for avoiding these defects. 



Course Outl ine 



A recommended conventional course outline, which permits early 
treatment of the ideas of statistical inference ami which stresses 
concepts rather than a proliferation of statistical techniques is 
given in this section. The suRt^ested pace has been indicated by 
assigning a number of hours to each t^ruup of topics. A standard 
semester contains 42 to 48 class meetings, and we arbitrarily allowed 
36 hours of class tv- for the presentation of new material; the 
slack time that we - ' oft provides for tests review etc. More 
detailed suggestion.- . 'ha: to mention only briefly and wliaL to 
emphasize are includeo in the Comments, Section 2. 
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CONVENTIONAL COURSE OUTLINE 



T opics 

Is Lroduction 



Lectures 
I 



1. Statistical Description ^ 

Frequency dis tributions, cumulative 
frequency distributions; measures of 
location and variation 

2. Probability 

Concept; sample space; addition theorem; 
marginal probability; conditional proba- 
bility; multiplication theorem; inde- 
pendence 

3. Random Variables and Probability Distribution.^ 2 

Concepts; simple discrete univariate 
probability distributions; expectation 
and variance of discrete random variables; 
functions of discrete random variables; 
mean and variance of functions of discrete 
random variables 

4. Special Probability Distributions 2 

Binomial probability distribution; con- 
tinuous probability distributions; normal 
probability distribution 

5. Sampling Distributions ^ 

Random sampling; mean and variance of sum 
of independent random variables; sampling 
distribution of mean; Central Limit Theorem; 
sampling distribution of proportion 

6. Estimation of Population Proportion ^ 

Point estimation of population proportion; 
confidence interval for population pro- 
portion based on large samples 

7. Tests Concerning Population Proportion 5 

Formulating hypotheses; statistical 
decision rules; types of errors; power 
of a test; construction of one-sided and 
two-sided tests (small and large samples) 

8. Inferences Concerning Population Mean 4 

Point estimation of population mean; 
properties of estimators: unbiasedness, 
consistency, efficiency; confidence 
intervals and one- and two-sided tests of 
hypotheses for the mean of a population whose 
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variance Is also unknown, based on small 
and large samples 

9. Additional Topics ^"^ 

Selection from the following: 

(a) Inferences concerning difrerenccs of two 
population means and proportions 

(b) Inferences concerning population variance 

(c) Chi-square and contingency tables 

(d) Regression and correlation 

(e) Analysis of variance 

(f) Nonparametric methods 

(g) Survey sampling 

(h) Quality control 

(i) Bayesian methods 
(j) Decision theory 

The number of lectures assigned to topics 1-8 is a minimal number. 
Use of computers, case discussions, and student-generated data will 
require additional time. Since these activities will vary from 
course to course, we have indicated a number of lectures for each 
topic without considering such activities. Consequently, the number 
of lectures available for additional topics usually will be less than 
the maximum of nine. We do recommend, however, that at least four 
lectures be devoted to one or more of the additional topics- 



2, Comments on the Course Outline 

General . Since the above outline contains only a list of 
topics, it does not recognize four important ingredients that we 
believe wil'' enhance the conventional approach: 

a. Continuing motivation of the student through examples and 
problems that he finds interesting and important. Data sets and 
student-generated data are discussed in Sections V and VII. 

b. Use of computers to help develop basic concepts such as 
the Central Limit Theorem as well as to remove the drudgery of sta- 
tistical calculations. Use of computers is discussed in Section VI, 

c. Emphasis on the basic ideas underlying statistical infer- 
ence and a demonstration of how these recur from one application to 
another. This requires skillful teaching and demands that the teacher 
see the broad picture of statistical inference. 

d. Student use of programmed learning materials for develop- 
ing mastery of important but routine topics. We believe it is 
wasteful to use precious class time having studertts practice con- 
structing frequency distributions, calculating measures of loca- 
tion and variation, using binomial and normal tables, etc. Class 
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time Is better used for explanation and discussion, not for routine 
calculations and drill. Examples of self-help programmed materials 
arc : 

[l] Elzey, Freo.man F. A Programmed Introduction to Statistics . 
Belmont, California, Brooks/Cole Publishing Company, 1966. 

[2] Gotkin, Lassar G. and Goldstein, Leo S. Descriptive 

Statistics: A Programmed Textbook , volumes 1 and 2. New York, 
John Wiley and Sons, 1965. 

[3] McCollough, Celeste and Van Atta, Loche. Statistical Concept s: 
A Program for Self -Instruction . New York, McGraw-Hill Book 
Company, 1963. 

[4] vmitmore, G. A., ^ aj,. Self -Corrcc ting Probler.^s in Statistics . 
Boston, Massachusetts, Allyn and Bacon, Inc., 1970. 

The suggested time allocation in the above outline makes it 
clear that, in our view, the early material should be covered quickly 
so that statistical inference can be reached in the first half of th » 



A non-exhaustive, illustrative list of texts fittir.g the pat- 
tern of the conventional course follows. 

Illustrative List of Texts for an Introductory Course : 

[5] Alder, Henry L. and Roessler, Edward B. Introduction to 

Probability and Statistics . 4th ed. San Francisco, California. 
W. H. Freeman and Company, 1968. 

Reviewed in Journal of the American Statistical Associa - 
tion , 64 (1969), p. 675. The first edition is reviewed 
in r.. >g American Mathematical Monthly . 68 (1961), p. 1018. 

[6] Freund, John E. Modern Elementary Statistics . Englewood Cliffs, 
New Jersey, Prentice-Hall, Inc., 1967. 

Reviewed in Journal of the American Statistical Associa - 
tion . 62 (1967), p. 1504. 

[7] Guenther, William C. Concepts of Statistical Inference . New 
York, McGraw-Hill Book Company, 1965. 

Reviewed in Journal of tlie American Statistical Associa - 
tion . 61 (1966), p. 5?9. 

[8] Hoel, Paul G. Elementary Statistics . 3rd ed. New Yorh, John 
Wiley and Sons, 1971. 

Third edition is reviewed in Journal oT the American 
Statistical Association. 67 (1972) , p. 497. 
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[9] 



Huntsberger, David V. Elements of Statistical Inference . 
2nd ed. Boston, Massachusetts, Allyn and Bacon, Inc., 1967. 



[10] Mendenhall, William. Introduction to Statistics . 2nd ed . 
Belmont, California, Wadsworth Publishing Company, 1967. 

Second edition is reviewed in School Science and Mathe - 
matics . 67 (1967), p. 754. 

[11] Walker, H. M. and Lev, J. Elementary Statistical Methods , 
3rd ed. New York, Holt, Rinehart and Winston, Inc., 1969. 

First edition is reviewed in Journal of the American 
Statistical Association . 54 (1959), p. 699. 

Following is a list of texts which may be helpful to the 
instructor as resource materials. 

Illustrative List of References for an Introductory Course : 

[12] Blackwell, David. Basic Statistics . New York, McGraw-Hill 
Book Company, 1969. 

Reviewed in Journal oi the American Statistical Associa - 
tion . 65 (1970), p. 1398 and in The .^erican Mathematical 
Monthly . 77 (1970), p. 632. 

[13] Dixon, Wilfrid J. and MasPi.y, F.J. Xntroduc tion to Statistical 
Analysis . 3rd ed . New York, ji'cCrav;-Hi 11 Book Company, 1969. 

Reviewed in JoMriial cf tho /xmor v can Statistical Associa - 
tion . 65 (19V0), p. ^f56. The st;cond edition is reviewed 
in The American M athn matical Monthly . 64 (1957), pp. 685- 
686. 

[14] Hodges, J. L., Jr. and Lehmann, E. L. Basic Concepts of 

Probc^' Uitv and Statistics . 2nd ed . San Francisco, California, 
Holden-Day, Inc., 1970. 

Reviewed in Journal of the American Statistical Associa - 
tion . 65 (l*j?0), p. 1680. The first edition is reviewed 
in The Amer-.can MaLtiematical Monthly . 72 (1965), p. 1050/ 

[15] Natrella, Mai.-y G. Experi.Tiental Statistics . Handbook 91. U. S. 
Department of Comifiercfc!, National Bureau of Standards, 1966. 

[16] Neyman, J. First Course in Probab ilitv and Statistics . New 
York, Henry Holt and Compaiiy, 1950. 

Reviewed in Journal of the American Statistical Associa - 
tion . 46 (1951), p. 386. 
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[17] Savage, I. Richard. Statistics : Uncertainty and Behavior. 
Boston, Massachusetts, Houghton Mifflin Company, 1968. 

Reviewed in Journal of the Amer ican Statistical Associa- 
tion . 64 (1969), p. 1677. 

[18] Snedecor, George W, and Cochran, W, G. Statistical Methods, 
6th ed, Ames, Iowa, Iowa State University Press, 1967. 

Reviewed in Ap plied Statistics . 17 (1968), p. 294. 

[19] Wallis, W. Allen and Roberts, Harry V. Statistics: A New 
Approach . New Vork, Ttie Macmillan Company, 1956. 

Reviewed in Journal of the American Stat istical Associa- 
tion . 51 (1956), p. 664. 

We turn now to topic-by -topic comments on the outline. These 
comments contain occasional references to books in the above lists. 

Topic 0. Introduction 

This lecture should be devoted to a discussion of the nature 
and importance of statistics, including the difference between the 
inferential nature of statistics and the deductive nature of mathe- 
matics. The first lecture should illustrate the existence of sta- 
tistical problems in everyday life in order to emphasize that sta- 
tics is problem-oriented. 

Source material which may be helpful includes: 

r20l Careers in Statistics . The Committee of Presidents of the 

^ American Statistical Association, the Institute of Mathematical 
Statistics, and the Biomctric Society. The Amer':an Statistical 
Association, 806 15th Street, N.W., Washington, D. C. 20005. 

[21] Kruskal, William, ed . Mathematical Sciences and Social Sciences . 
Englewood Cliffs, New Jersey, Prentice-Hall, Inc., 1970. 

[22] Sills, David L. , ed . Internationa l Encyclopedia of the Social 
Sciences. New York., The Macmillan Company and the Free Press, 
1968. Listings under: 
Statistics 

Statistical analysis 
Survey analysis 

[23] Tanur, Judith, et al . , eds. Statistics: A Guide to the 

Unknown . San Francisco, California, Uolden-Day, Inc., 1972. 

[24] ThP Mathematical Science ^: A Collection of Essays. Edited by 
The National Research Council's Committee on the Support of 
Research in the Mathematical Sciences (COSRIMS) with the 
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collaboration of George A. W. Boehm. Boston, Massachusetts, 
MIT Press, 1969. 

[25] Wallis, W, Allen and Roberts, Harry V, Statistics: A New 
Approach . New York, The Macmillan Company, 1956. 

Topic 1. Statistic al Description 

flpnpral coinments . The discussion should begin with a problem 
that will motivate the need for statistical data and their ^"aly^i^ 
through frequency distributions and descriptive measures. A good 
problL may be used to give an overview of the course raising ques- 
tions relating to later topics. Instructors will be able to find 
problems for which data of local interest from registrars "cords 
are appropriate. Examples: Are student entrance test scores higher 
today than they were five years ago? Is student family economic 
status higher today than it was five years ago? Are college-age 
students today taller than they were 30 years ago? Do college apti- 
tude test scores for men differ from those for women? 

Our suggestion departs from the usual approach in which data 
are provided without the context of a problem, and a frequency dis- 
tribution or a variety of descriptive measures are calculated for 
their own sake. The suggested approach ^"Pl^f 

ference from the start; the instructor should not hesitate to raise 
questions about inferential problems that will be considered later in 
the course. 

A comparison of a frequency distribution with an expected, 
theoretical distribution, such as the birth pattern distribution in 
R A v^-'y^-r-'-^ Sr-aMstical Methods for R esenrch Workers* (p. 67J, Is 
useful for introducing ideas of statistical inference. So ^ bi- 
modal distribution, the problem being whether it is made up of two 
different groups, each with a different pattern of variation. 

Specific suggestions . 

a. Class-generated data, from which one or several frequency 
distributions are constructed, often interest students. 

b. In discussing frequency distributions, one should emphasize 
the variation inherent in the phenomenon under study and the pattern 
of this variation. Examples of different phenomena (e.g., life of 
light bulbs, number of calculators out of order per day) should be 
utilized to demonstrate widespread presence of variation. 

c Data for constructing frequency distributions should be 
simple, so that little time is spent on developing class limits. 



r26l Fish er, R. A. Sr.nMstlcal Methods for Research Workers , 
13th ed. New York, llafner Publishing Company, 1958. 
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d. The discusnion of frequency polygon and histogram can be 
used to distinguish ber^-een continuous and discrete variables, 

e. In taking up the descriptive measures of location (mean, 
median) and of variation (standard deviation, range), alternate 
computational forms of the mean and standard deviation should be 
called to the student's attention, but no derivations should be 
given. A useful means of pointing out the applicability and limita- 
tions of these measures is through a comparison of two or more fre- 
quency distributions (e.g., income distribution for 1970 and 1971). 

f. Class time is better devoted to discussion of the meaning 
and limitations of various measures of location and variation than 
to drilli?!^; students on their calculation. 

g. Mean and median should be explained as alternate descriptive 
measures of location, neither of which is perfect for all sif:uations. 



Topic 2. Probability 

General comments . The way in which introductory probability is 
presented can vary greatly. It is a broad topic, intensive examina- 
t;ion of which leads to deep philosophical problems. The approach of 
Blackwell [l2] In the first three chapters is elementary. The con- 
cept of area is used when extended ideas are required. The basic 
laws of probability are developed, making effective use of tables and 
diagrams. A major advantage of the presentation is that it stays 
consistently at a modest mathematical level without disruptive 
digressions . 

A more complete exposition of finite probability tlieory is 
presented by Hodges and Lchmann in [l4]. Cliapters 1 and 4 contain 
material appropriate for an introduction to probability In tne 
elementary statistics course. We suggest this reference as additional 
reading to augment the material in Blackwell. 

An interesting aspect of the modern empltasis in probability is 
that of assigning personal or subjective probabilities to events. 
For an elementary introduction. Savage [l7] seems appropriate. The 
discussion includes a great deal of gambling terminology whicli may 
not appeal to all students. At the end of the cliapter there arc many 
stimulating notes and problems that are used to extend the tlieory and 
to show examples of probabilistic reasoning occurring in everyday life. 
Hodges and Lehmann [l4] liave a sliort section on subjective probability 
beginning on page 12 7. 

Specific suggestions . 

a. Since only three lectures are devoted to probability, 
discussion must be restricted to tlte major concepts, and proofs will 
need to be kept to a minimum. Only finite sample spaces should be 
used for explaining tlie probability concepts. 
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b. The relative frequency interpretation is a useful way to 
motivate the concept of probability. The equally-likely notion 
should not be given major emphasis, though it may be helpful if ex- 
tended to real-life situations such as taste experiments or genetic 
problems . 

c. Wh.ether set notation is to be used depends on the mathe- 
matical training of the students. At any rate, the allotted time in 
the suggested outline does not permit the teaching of set theory or 
even of basic set concepts. The teacher may, however, wish to point 
out that probsbility theory is based on set theory. 

d. In teaching statistical independence, the conditional 
def init ion : 

If P(A|b) ^ P(A), then A and B are independent, 
is easier for the student to understand than the product definition: 
If P(AB) = P(A)P(B), then A and B are independent. 

e. The small amount of time allotted to probabi lity makes it 
imperative that teachers not get bogged down in combinatorial proba- 
bility problems. Simple, though realistic, examples should be used 
to illustrate the probability concepts covered. 

Topic 3. Random Variables and Probability Distributions 

General comments . Random variables, probability distributions, 
and expectations are treated in fairly standard ways in most texts. 
A simple presentation is given by Blackwell [12], but his presenta- 
tion is very brief. 

Specific suggestions . 

a. Do not give a formal definition of random variables; a 
statement that "the value of a random variable is a number determined 
by the outcome of an experiment that varies from trial to trial 
should be adequate. 

b. Introduce probability functions and cumulative distribu- 
tion functions in terms of simple examples with a small number of 
points and associated probabilities. Functions of random variables 
also should be considered only in terms of such simple examples. 

c. Stay on the intuitive level. Many definitions and results 
are intuitively reasonable for most students; for instance: 
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E(X) - Ex^P(X = x^) 

E(kX) = kE(X) 

a(kX) = ka(X), k > 0 

d. Use simple everyday examples, with three or four outcomes 
only e.g., the number of calculators needing repair in a group of 
f^ir'calc^lato^s; the number of males in families of five persons. 

e The mean and variance of a linear function of a random 
variable should be mentioned and their usefulness illustrated by a., 
example, but formulas should not be derived. 



Topic 4. Sopcial Proh ahtlttv Distributions 

Ge neral comments . Student participation can be developed both 
through access to a computer on an individual basis and through 
elementary class exercises involving coin tossing, tables of "ndom 
no'al deviates, and exercises of this kind. The results of student 
ex^cises can b; combined to demonstrate sampling variation over the 
various samples obtained individually by students, thus serving as 
an introduction to Topic 5, Sampling Distributions. 

Specific sugges i-jons . 

a. State the conditions for a probability distribution to be 
binomial but do not derive its formula. 

b. Formulas for the mean and variance of a binomial distribu- 
tion should be given and illustrated by a simple example but should 
not be derived. 

c. Tables of binomial probabilities should be used to demon- 
strate characteristics of binomial distributions such as skevmess. 
Students should not be asked to calculate binomial probab.Uties 
repeatedly. 

d. Use a variety of realistic examples. Do not confine 
examples to coin tossing; e.g., use the number of defectives in a 
sa^'le fr^ a shipment of parts or the number of voters favoring an 
issue in an opinio! poll. 

e The transition to a continuous random variable for which 
area represents probability, can be facilitated by considering a 
histosram and shrinking the width of the classes. 

f. The normal distribution can be introduced as: 

(i) an approximate description of many real-life 

phenomena, such as weights of the contents of cans 

of fruit or the Scholastic Aptitude Test scores of 
students ; 
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(il) an approximation to certain discrete distributions, 
such as the binomial distribution or the distribu- 
tion of the sum of the digits on three dice. 

The text used will influence the approach taken, but both notions 
should be introduced. 

g In discusiing the normal distribution, one should empha- 
size the variety ol shapes encountered for different values of p. 
and a and the method for transforming any normal random variable 
to a standard normal one. 

h. Realistic examples should be used for the normal distri- 
bution. Students will probably be interested in SAT scores, for 
which the mean is 500 and the standard deviation is 100. 

i Unless the text makes the continuity correction an inte- 
gral part of the normal approximation to the binomial distribution, 
this topic should not be taken up or should be mentioned only 
briefly. 

Topic 5. Sampling. Distributions 

G eneral comments . Computers are effective in demonstrating 
sampling variability and sampling distributions. Exercises can be 
developed for m-iny distributions where the computer takes repeated 
samples of fixed size and. for example, provides information on the 
distribution of the sample mean through plots and histograms. The 
student learns of the nature of sampling variation and can proceed 
through variation in sample sizes to obtain insight into the in- 
herently increased stability of sampling distributions as sample 
sizes are increased. The student can be given insight thereby into 
the behavior of the variance of a mean and into the concepts of the 
Central Limit Theorem. 

Specific suggestions . 

a The concept of the sampling distribution of the mean can be 
explained initially by considering a small finite population and 
sampling with or without replacement with a small s^^P^^^^^^^ 
(n = 2 or 3). This permits the exact sampling distribution of the 
mean to be developed by enumeration. The mean and variance of this 
sampling distribution can then be studied. 

b Since the Central Limit Ttieorem should only be stated and 
not proved, evidence of its operation will need 8^^^" '^;! 

student. Some texts contain exact sampling distributions for d f 
ferent sample sizes or the results of sampling experiments. Vrtn^ 
outs of cXuter runs simulating sampling distributions for different 
sample sizes can also be distributed to students ^ j^^^^^f^' J' 
a computer is not available on campus, printouts could be obtained 
from a computer located elsewhere. 
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These approaches are helpful but, in our opinion, are not as 
effective as having students participate in sampling experiments. 
A simple experiment is to sample a rectangular distribution, either 
from a table of random numbers, by drawing chips from a bowl, or by 
computer. If a computer is used, it will also be easy to sample 
other kinds of populations. Sampling a moderately skew population 
may help convince students of the Central Limit Theorem in the 
absence of symmetry. Indeed, the use of several populations (e.g., 
rectangular, exponential) can demonstrate to the student that the 

rapidity with which the sampling distribution of (x - u) -t (a/v^) 
approaches a normal distribution as n increases depends on the 
population from which the samples are selected. 

c. It should be pointed out to students that the sample pro- 
portion is a mean, and hence the Central Limit Theorem applies 
directly to sample proportions. 

Topic 6. Estimation of Population Proportion 

General comments . If the teacher prefers, he can take up 
estimation of the means of continuous populations and tests concern- 
ing them before he discusses inferences on population proportions. 
Inferences on proportions are, in our opinion, somewhat simpler to 
present; e.g., binomial tables can be used to derive the power of 
tests. Hence, we place inferences on proportion'i before inferences 
on means of continuous populations. 

Also, testing hypotheses can be taken up before estimalLon. 
We recommend taking up statistical estimation first because we 
believe it is easier for the student to understand than hypothesis 
testing. 

The most common interpretation of a confidence interval has 
been that of a random interval which contains a fixed parameter with 
given probability over repeated applications. This point of view 
has been presented traditionally in most texts. Through use of sub- 
jective probability and Bayes' Theorem, one can interpret a confi- 
dence interval as a fixed interval (for given observed data) which 
contains a random parameter with given posterior probability. 
Savage [l7] puts forward both concepts (see page 209 and page 260) 
and points out basic differences in philosophy. 

Specific suggestions . 

a. Tlie large sample confidence interval for the population 
proportion p can be developed readily by relying on an extension of 

the Central Limit Theorem which states that (p - p) -r ^^(l - p)/n 
is approximately normal for large sample size n, f) being the 
observed proportion. 
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b. An experiment with repeated sampling of a knovm popula- 
tion, setting up a confidence Interval each time, can be helpful In 
conveying the Idea of the confidence coefficient and In Illustrating 
that the location and width of the confidence Interval varies from 
sample to sample. This can be done either by computer or by class- 
generated samples. Such an experiment Is particularly desirable 
since It will provide evidence of the working of the extension of 
the Central Limit Theorem. 

c. Realistic examples, such as estimation of the proportion 
of voters favoring a candidate or the proportion of persons In the 
labor force who are unemployed, will be helpful In Illustrating the 
pervasiveness of estimation problems. The subject of sample surveys 
tn general may be discussed In connection with statistical estima- 
tion. 

d. The discussion of confidence Intervals should consider the 
usefulness of the particular confidence Interval obtained. For 
instance, in a close election race Involving two candidates, a con- 
fidence Interval for the proportion of vott favoring one of the 
candidates which ranges from .45 to ,53 may not be useful. Discus- 
sion of several such examples can help the student to recognize that 
different problems may call for different levels of precision. 

e. The determination of the confidence coefficient should be 
discussed In general terms. Several examples may be used to Illus- 
trate that important problems, such as estimating the unemployment 
rate for purposes of determining national economic policy, call for 
higher confidence coefficients than do less important problems. 

f. The determination of the sample size required to yield a 
confidence Interval of sufficiently small width for a given confi- 
dence coefficient provides a useful means of Introducing the student 
to the notion that statistical Investigations should be planned In 
advance* 

g. In discussing Interval estimation of the population pro- 
portion for small sample sizes, reference should be made to tables 
or to the Clopper-Pearson charts which appear In many texts and 
books of tables. See, for example, 

[27] Owen, Donald B. Handbook of Statist ical Tables. Reading, 
Massachusetts, Addlson-Wesley Publishing Company, 1962. 



Topic 7. Tests Concerning Populat ion Proportion 

General comments . This subject can be discussed either by 
considering small sample sizes first and then large sample sizes, 
or vice versa. An advantage of beginning with small sample sizes Is 
that power calculations can readily be made by using widely avail- 
able binomial tables. A disadvantage Is that the power obtained for 
small sample sizes will be relatively poor so that the student may 
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Btermlnlng the exact critical region. 



c. Realistic problems should be used when the student is 
sked to formulate the appropriate alternatives Hq and 11^. 

d. Students can often be helped by introducing the critical 
Bgion in terms of the statistic p, the sample proportion. For 
nstance, if: 

"O P ^ Po 
: P > p^, 

he student can readily see that the appropriate decision rule is of 
he form: 

if p ^ A, accept Hq, 

if p > A, accept , 

here A is the cut-off point to be determined. It can tlien be 
xplained how to determine A if, for example, the probability of 
oncluding when p = p^ is to be or. 

The standardized statistic (p - p^) ./p^O~^^~P^T/n for 

etermining the critical region is a confusing way to introduce the 
tudent to testing hypotheses. After the student gains some 
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familiarity with testing hypotheses, the standardized statistic then 
is more easily used. 

e. In developing the properties of a statistical decision rule 
for testing hypotheses, attention should not only be given to the 
power curve of the decision rule but also to the error curve which 
shows the probabilities of error directly. Many students understand 
the implications of a decision rule for testing more easily through 
the error curve than through the power curve [e.g., if : p S p^, 

: p > p^, then P(Error) = P(Accept | p) for P ^ and 

P(Error ) = P(Accept I p) for p > p^)]. 

f. When discussing the two-sided test, one should explain the 
correspondence between the confidence interval for the population 
proportion and the testing approach. 

g. When small sample sizes are considered first, the power of 
a test and the error probability for a given population proportion 
should be obtained using binomial tables rather than by making actual 
calculations. Binomial tables can then be used to set up a decision 
rule with specified control on type I and/or type II errors. At this 
point a transition can be made to the case of large samples and the 
use of the normal approximation. 

h. Students often do not understand how the p^ level is 
determined in an actual problem. This situation can be clarified by 
illustrating a variety of situations, for instance: 

(i) In deciding whether a company should accept or 
reject an incoming shipment, may be the break- 
even proportion of defective items for which it 
is equally costly to accept or reject a shipment. 

(ii) In an experiment to determine whether a person has 
extra-sensory perception by having him indicate 
whether coins flipped in a different city are heads 
or tails, p^ may be .5, the level expected if the 

person were guessing and no ESP were present. 

These examples illustrate two commonly encountered situations, 
namely those for which p^ is the break-even proportion and those for 

which D is determined by theoretical considerations as the level 
•^o 

where no effects, or no effects of practical significance, are 
present • 

i. Discussion of the determination of the probability of a 
type I error (size of test) a may usefully be combined with the 
problem of how to determine sample size, as follows: 



21 



(i) For given n and a, find the probability of a type II 
error ^ at an appropriate value of p. If 3 is satisfactory, use the 
given n and o. If 3 is too high, increase the sample size. If no 
increase in sample size is possible, raise a until a suitable balance 
between cy and p is found. 

(ii) If, for given n and a, 3 turns out to be smaller 
than necessary, the sample size may be reduced or a lowered. 

J. Sampling experiments to demonstrate the behavior of a given 
decision rule for different levels of p may be a helpful supplement 
for many students* 

Topic 8. Inferences Concerning Population Mean 
Specific suggestions . 

a. Some major properties of estimators (unbiasedness, con- 
sistency, and efficiency) could be discussed here, but only briefly. 
If they are discussed, we recommend that it be done here rather than 
in Topic 6. We feel that students should first become acquainted 
with the general concept of statistical estimation before they become 
concerned with properties of point estimators. 

b. In discussing the small-sample confidence interval based on 
the t~distribution, emphasis should be placed on the robustness 
(insensitivity of properties of the procedure to departures from the 
assumption of normality) of the t-statistic and the consequent wider 
applicability of this confidence interval to populations which are 
not exactly normal. 

c. In developing inferences concerning population means, 
students should not be asked to perform extensive calculations to 
find the sample mean and standard deviation. 

d. Sampling experiments for estimation and testing with small 
sample sizes can be helpful in several ways: 

(i) When sampling a normal population, the experiment 
will give the student further confidence in the 
t-distribution and will illustrate once again the 
meaning of the confidence coefficient or the level 
of sign if icance and power . 

(ii) When sampling a population moderately different from 
a normal population (e.g., a rectangular population), 
the experiment will illustrate the robustness of the 
t-statistic. 

e. We recommend bypassing the case of known a unless inferences 
concerning the population mean are considered before inferences con- 
cerning the population proportion. The reason for this recommendation 
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is that the case of known a does not arise often in practice and only 
serves Co introduce an unnecessary repetitive element for the student. 

Reliance should be placed on Oc - - (s / .Jn) being approximately 
distributed as t for small n for populations not departing exces- 
sively from a normal population and being approximately distributed 
as a standard normal variable for larger n for almost all populations. 

If there is time available to discuss planning the sample size 
or to determine the power of the test, we recommend the use of charts 
such as those in Guenther [7]. For the case of unknown a these 
charts could be entered by using two values of a within which the 
standard deviation is expected to fall, thereby obtaining bounds on 
the power or sample size. 



Topic 9. Additional Topics 

Students in the social sciences might benefit most from topics 
a, c, d, f (see page 9); in the physical and biological sciences, 
from topics a, c, d, e; in management science, from topics g and h; 
in economics, from topics d and h; in education, from topics a, d, f. 
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IV. SOME ALTERNATE APPROACHES 



In this section we discuss three alternate approaches to the 
introductory statistics course. Each approach provides great poten- 

ialfor innovation, and some Instructors may wish to try one or 
several of these In Ueu of the conventional ^PP^-^ f r two of 
the alternate approaches (decision theory, nonparametrlc) , 
of possible textbooks are available. Since the textbook used will 
have a ma or effect In the determination of the precise contents the 
ord'r of presentation, and the amount of time to be devoted to the 
various topics, no effort Is made here to present outlines. Instead 
we discuss the principles underlying the use of the approaches. This 
rill serve to Indicate potential advantages and disadvantages and to 
proilde a foundation In terms of which the Instructor may Interpret 
various texts that are now and will later become available. 

No text designed specifically for the third approach (problem- 
oriented) Is avalUble, to the best of our knowledge ^he nstruc or 
wishing to Implement this approach must be prepared for substantial 
developmental efforts. 

1. A Decision Theory Cour sp in Introductory Statistics 

n,... .Indents of the course. Decision theory Is a formulation 
of statistical problems In which the statistician has available a 
choice of actions, the consequences of which depend on an unknown 
stae of nature. To help decide on an appropriate action, one must 
perform an experiment which will yield relevant data to help deter- 
m!nf the state of nature. Since the data generally depend not only 

th ta of nature but also on chance, uncertainty ^PP""^^"^^ - 
places--the effect of chance. I.e., random variation, and the Initial 
Ignorance of the state of nature. 

A decision theory course in Introductory statistics should 
Include the following concepts. 

Concepts: Philosophical principles of decision-making under 
^^^nty; averages and measures of v^i-billty; pro ability 
and expectation; utility; Bayes' strategies and poster or 
probabilities; the parameters of distributions relevan for 
optimal actions; testing hypotheses, significance levels, 
estimation, confidence intervals. 

theorem. 

Traditional statistical techniques of handling data such as 
histograms, cumulative frequency polygons, means and standard 
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, . „o^ ^/^^nl to the decision theory approach. Their 

deviations are not vital to cne uu „^,,n»oi»ic value, however, In 

co'idcnc: intervals arc not easily blended with this approach. 

Results o£ decision theory have implications i" business and 
Results on oe. decisions must be made in the face 

r/'^nc^r^aiity! llTTTo choice must consider consequences of the 

available actions. 

and f -°^v-^ri^..:o;/rp"^°°cH^'rer^ ^f^ 
""■^ TaibL lie's in%h rob -"Solvln orientation. Each example 
c^^^^ered Incites a problem In decision-.aking which requires a 
good and sensible answer. 

ThP decision theory approach should appeal to students who are 
interel^ed in tirph losophlc^ foundations of scientific inference 

tistics. 

Ihl. «ur.. win -ot «r™ for . .cado.t »l.o i. .xpret.d to 

i^:: .r*. ..jo, .00- 
i,Si;'fo.r.;L'";ir>'r„"to^"u'5;;roo; «. ...n-o.. 

with data analysis. 

Another limitation of 'f^^f„^^--^,l^,i:^L:?'';roblem: in'the' 
th rrhe^:t:tiric ri u:ed t^ "now precisely the set o£ 

rariab^irac^lon-'t rset o. fr-t,^^%ri:::nt°;robrUtr.is trlbu- 
sequences o£ the actions and '''^"'^^^"'bility of error In 

tions. Little allowance is for the possibi ity 

specifying the model. No prevision is made for learning 

^no a minimum of "-'^^-^'^f^^^^^^^r fatl'to^e^Jor-^'^f 
student who is very weak in mathematics will tail to J y ^^^^^ 

:s: :^.^;"■.2.r;".^.;s;."^.:2o!:"^.i^.. 



ideas . 
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Finally, the opportunities to apply the ideas and methods of 
such a course in other academic work are relatively few, altl^ough 
Such opportunities seem to be increasing steadily as decision-making 
becomes used more and more in diverse fields such as business, 
engineering, and medicine* 

Illustrative List of Texts and References : 

[28] Aitchison, John. Choice Against Chance: An Introduction to 

Statistical Decision Theor^r . Reading, Massachusetts, Addison- 
Wesley Publishing Company, 1970. 

Reviewed in The Australian Journal of Statistics . 
13 (I97I), p. 123. 

[29] Chernoff, Heman and Moses, Lincoln E. Elementary Decision 
Theory . New York, John Wiley and Sons, 1959. 

Reviewed in Journal of the American Statistical Associa - 
tion . 55 (I960), p. 291 and In The American Mathematical 
Monthly . 67 (I960), p. 487. 

[30] Hadley, G. Introduction to Probability and Statistical 

Decision Theory , San Francisco, California, Holden-Day, Inc., 
1967. 

Reviewed in Journal of the Royal Statistical Society . 
Series A, 131 (1968), p. 437. 

[31] Lindgren, B. W. Elements of Decision Theory . New York, llie 
Macmillan Company, I97I. 

[32] Lindley, D. V. Making Decisions . New York, John Wiley and 
Sons, I97I. 

[33] Raiffa, Howard. Decision Analysis: Introductory Lectures on 
Choices Under Uncertainty . Reading, Massachusetts, Addison- 
Wesley Publishing Company, 1968. 

Reviewed in Journal of the American Statistical Associa - 
tion . 64 (1969), p. 1668. 

[34] Schlalfer, R. Probability and Statistics Cor Business 

Decisions: An Introduction to Managerial Economics Under 
Uncertainty . New York, McGraw-Hill Book Company, 1959, 

Reviewed in Journal of the American Statistical Associa - 
tion . 54 (1959), p. 813. 



26 



3: 



ninended objectives, the course should not become technlque- 
; one should avoid making the course a compendium of non- 
Ic and parametric methods* 

vantages and disadvantages of the nonparame tr Ic approach * 
of nonparametrlc methods provides several potential advan- 
WlCh the availability of appropriate tables, the detailed 
of numerical examples, regarded by many as essential to a 

grasp of principles as well as techniques. Is simple and 
rhe methods are easily Interpreted and have natural and 

justifications. The methods have the advantage of robust- 
tius the student Is quickly Introduced to useful and simple 
es which have wide applicability. This exposure to statlstl- 
epts throughout the course provides the student with a founda- 

a good understanding of standard parametric procedures. 

c the student who Is required to take statistics to satisfy 
ids of a major field in which statistics Is used, this course 
/ to provide an Introduction to some useful nonparametrlc 
at an elementary level. 

najor disadvantage of this approach Is that students will 
tie or no exposure to those parametric methods needed for 
rk In other subjects. Another disadvantage Is that current 
nonparametrlc statistics do not focus on either point or 
estimation. Also, there arc few texts at the elementary level. 

27 



TH i Mnr n r lvr M nr Trn^" ^" Tnt-roducrorv coyirse t 

[35] Conover, W. J. P^^oMml Nonc-^'^^rr ic Statistics. New York, 
John Wiley and Sons, 1971. 

Reviewed in Tonrnnl of th » American Statistical Associa- 
tion . 67 (1972), p. 246. 

rifil Kraft Charles H. and van Eeden, Constance. A _ Nonparametrlc 
^^^■^ T!!:'l'^.nn .n Statistics . New York, The Macmlllan Company, 
1968. 

Reviewed in -Tnnrn.l of the AniPrican ^^^f ^ " ^ ^^^^/""^^^^ T 
tlon , 66 (1971), p. 223 and in THp American Mathematical 
Monthly . 77 (1970), p. 207. 

r37l Noether Gottfried E. Tntroduction to Statistics: A Fresh 
^ ^ Aooroach . Boston, Massachusetts, Houghton Mifflin Company, 
1971. 

Reviewed in Jnurn«1 of th ^ American Statistical Associa- 
tion . 67 (1972), pp. 496-497 and in The Mathematics 
Teacher, 64 (1971), p. 630. 

nH.or Selected Rpferences in Nonoarametr Ic Statistics: 

[38] Bradley, James V. Distr fhutlon-Freo ist leal Tests 

Englewood Cliffs, New Jersey, Prentlce-lUll, Inc., 196S. 

Reviewed in Jn.irnal of th » American Statistical Associa- 
tion . 64 (1969), p. 1090. 

[39] Gibbons, J. Nnnpnr.metric Sr^ristiral Inference. New York, 
McGraw-Hill Book Company, 1971. 

[40] Hajek, Jaroslav. M..p...^.^r tc Statistics. San Francisco, 
California, Holden-Day, Inc., 1969. 

Reviewed in the An^trnltan Journal of Statistics, 
13 (1971), p. 123. 
[41] Noether, Gottfried E. Flemenrs of Nonparamerrlc Statistics . 
New York, John Wiley and Sons, 1967. 
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we present two examples. As these examples will make clear, the 
envisioned problem-'oriented course differs sharply from present 
courses • In most current textbooks , prob lema are used simp ly to 
provide examples with which to illustrate the method under study. 
Often the problems are artificial and noncompelling, and the Intel- 
lectual challenge to the student is limited to the study of how to 
carry out the details of the method correctly rather than of what 
method to apply and how well it works in the problem. 

The problem-'oriented course will not be easy to teach. As the 
need for more material on statistical concepts arises, assignments 
will have to be made in supplementary texts, programmed materials, 
or handouts developed by the instructor. 



Example 1: The Peach Crop , A cling peach crop has been 
insured against frost damage by a growers' association. A frost 
occurs and a court must adjudicate disagreement between the growers 
and the insurance carrier on the amount of damages. 

One possiule way for deciding the compensation to be paid to 
growers is to examine each of the 26,793 trees In the orchards 
belonging to members of the association. An impartial expert could 
assess the damage to each tree. If he assesses the peaches on a 
tree as 15% damaged, the damage would be 37 X .15 « 5.50 dollars, 
where 37 dollars is the estimated average value of the peaches on 
undamaged trees. Theoretically, all 26,793 trees in the orchards 
could be examined ir order to obtain a total damage figure. 

Clearly, it is unreasonable to examine all the trees. Indeed, 
the cost of doing so would far exceed the value of the crop, A 
statistical consultant proposed examining a sample of 100 trees 
randomly selected from among all 26,793 trees in the orchards and 
using the average damage to the crop per tree in this sample as an 
estimate of the average damage per tree in the total population. 
His advice was taken, and the sample resulted In damages of 5,50, 
7.10, 9.90, ,,,, 1.57, with a mean of 6.31. Wlien this mean is 
multiplied by the number of trees in tlie orchards, an estimate of 
6.31 X 26, 793 » $169,063.83 is obtained Cor tlie value of the damages 
suffered by the growers. 

The growers are concerned about this procedure. They wisli to 
recover the full damages caused by the f ros t , but they are anxious to 
avoid being criticized by the court for using the wrong method of 
estimating the damages to the peaches. Tliey ask, "Is the above 
estimate the correct value for the damages to tlie peach crop?" No, 
it is not. It is an estimated damage; it is impractical to obtain 
the actual data needed to compute the "correct" damage. "Tlie law 
is not clear on how to treat estimates. Would a mathematician say 
that this is the correct estimate?" This Is not a matliematical prob- 
lem in Che sense that there exists a "correct" way to select and 
analyze the data. It is a statistical problem. The question should 
be whether the procedure used to arrive at this estimate is a reason- 
able procedure for an unbiased statistician. It seems reasonable. 
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but to answer thia question In a Tneanlngf.il w/>y.^wc munt know how 
an eatijnate obtained by this method Is related tO tlie unknown 
"damage" and how estimates from alternative methods would compare 
with this. 

Up to this point the concepts of random sample and averaKO have 
been used. These terms can and probably should be explained in actall 
after some of the more pressing problems are discussed. It is neces- 
sary now to point out that the estimate is random and to illustrate 
how the estimate would have varied if the experiment liad been repeated 
10 times. It would be valuable to consider the consequence of scleet- 
ing different sample sizes and the cost of sampling. The noceasity 
of dealing with variability is now clear, and the Central Limit 
Theorem can be hinted at or discussed briefly. 

An analysis of the data from simulation would use histograms, 
means, and standard deviations. These could be presented in a 
matter-of-fact way. Instructions on how to carry out tiie presenta- 
tions and analyses need not be given immediately if these concepts 
are easily enough appreciated in this specific context. 

At this point one can extend the problem in several directions. 
One can make it more realistic by adding the fact that the orchards 
are located in two different river valleys and tiiat the location and 
elevation of the orchards can be used as a basis for stratified sam- 
pling. This raises the point that the more one knows, the better one 
can do; it raises the question of how to profit from vague informa- 
tion. 

Alternatively, one can discuss the advantages of r^mdomization 
to avoid hidden bias. 

Suppose that, due to a clerical error. It was reported that 
there were 700 trees in a certain orchard, whereas the actual 
figure was 70. The statistician might not wish to decrease his 
original estimate accordingly, because the 630 nonexistent trees 
had had a chance of being sampled and could have yielded a 0. An 
adjustment would make his estimate biased, and he would not under- 
stand the sampling properties of such ex jTOst facto procedures. 
On the other hand, if he were to testify in court, his opinion 
might be criticized if the estimate were not adjusted. 

Another question that may arise is how much the Insurance 
carrier should pay for damage to the crop if they are confident that 
it is between $150,000 and $190,000. Should the carrier pay $2,000 
for increased sampling which is likely to reduce the length of the 
confidence interval to $10,000? Should one regard a payment of 
$170 000 in the first case as a gamble in which the insurer risks as 
much as $20,000? Would the $2,000 qualify as a prudent expense to 
reduce the amount at risk from $20,000 to $5,000? What is a reason- 
able trade-off? 
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It is apparent that this simplified example has enormous 
potential for illustrating statistical concepts in a context which 
is meaningful and interesting. Indeed, there is some danger of 
dwelling too long on one example, as students may become bored with 
it. 



Example 2: Death Takes a Holiday . Do famous people, people 
wiiose birthdays are likely to be celebrated publicly, put off dying 
until after their birthdays? To answer this question, David Phillips 
studied the birth and death days of over 1,200 famous people (Tanur, 
Judith, e^ aJL., eds. Statistics: A Guide to the Unknown [23]). To 
make the classification less tedious, he examined only the birth and 
death months. 

There are two conflicting hypotheses. One states that there is 
no relation between birth and death months. According to this hy- 
pothesis, someone born in April is as likely to die in November as 
someone born in December. The alteriUf^ hypothesis states that in- 
deed there is a relation between blrC. and death months, that someone 
born in December is less likely to die in November Chan someone born 
in April. 

Phillips does not present a formal test of these hypotheses in 
his paper. He shows that for four different sets of data, the month 
before birth is less often a death month and the four months after 
birth are more often death months. The consistency of this result in 
all four sets of data is interpreted as increasing the plausibility 
of the alternative hypothesis, specialized somewliat to include the 
four-month death rise after the birth month. 

What concepts are raised by this problem? The student is 
introduced to two-way contingency tables (month of birth and month of 
death) and the use of observed proportions as estimates of probabil- 
ities. Confidence intervals can be introduced to assess whether an 
observed proportion is consistent with a theoretical expectation. 
Tnc idea ot testing hypotheses and the use of the chi-square test 
enter naturally, as does the notion that the chi-sqiiarc test is an 
all-purpose test whose power can be improved upon in the presence of 
a sufficiently specific alternative hypothesis. This point gives one 
an opportunity to discuss problems about designing hypotheses after 
studying the data. Finally, there is the problem of describing in- 
dependence carefully and indicating how this hypothesis differs from 
a uniform distribution in the length of time between birth and death 
months. 

This problem emphasizes the need to supplement informal heuris- 
tics by a sound theoretical framework which serves to guarantee that 
plausible conclusions are sound. Further, this problem is not closed. 
Several additional questions are open to study. The death rate in 
the birth month is also high. Should this enter the analysis? What 
would a detailed study of death dates within a month of the birth date 
show, and can this be studied effectively in view of the potentially 
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small samples Involved? Does the ability of modern medicine to pro- 
long life for a few days If necessary have an effect on the death 
rate very near the birth date? There seem to be low death rates four 
and six months before the birth month. Does this mean anything. 



AHvAntages and disadvantage s of the problem-oriented approach . 
Some major advantages of the problem-oriented approach are: 

a. Discussion of meaningful and nontrivial problems evokes 
Interest and raises fundamental statistical questions. 

b. Sensible, even if only partial, answers to realistic 
questions provide reinforcement for understanding of key concepts 
and motivation for further study. 

c. The opportunity to use computer simulations is valuable 
and may help to motivate students. 

d. A feeling for the excitement of research is derived when 
the traces of false starts and preliminary studies are not erased. 

Some major disadvantages of the problem-oriented approach are: 

a This approach leads to the use of methods and ideas that 
have not been carefully digested in advance. There will be some need 
to operate at levels of less than complete understanding. The 
uninvolved and unmotivated student may find it difficult to salvage 
anything from such a course. 

b Live problems are often very complicated. It will be 
difficult but necessary to simplify without throwing away too much 
of the essence. 

c While this approach should be exciting to those who are 
involved, it may be frustrating to students who expect to be told 
whit to do and how, and who find open-ended questions or nonresolved 
philosophical issues difficult to tolerate. 

d. In this approach, concepts and methods arise in context 
and not in a systematic framework for review by the student without 
undue repetition . 

e. The heuristic approach suggested here sometimes leads to 
incorrect results or paradoxes. When these are corrected, the 
student may feel insecure. How is he to know when his reasoning is 
sound without being told by the teacher? Some rigorous follow-up 
may be necessary. 

f. Problems that seem easy may require a good deal more 
maturity from the students than we think. It may be diffic"!^ 

to transform unmotivated students, required by their ™-J" f P"' 
ments to take a statistics course, Into participants In statistical 
inquiry . 
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Selected Sources for Cases : 



[43] Brownlee, K. A. "Statistics of the 1954 polio vaccine trials." 
Journal of the American Statistical Association . 50 (1955), 
pp. 1005-1014. (An invited address on the article "Evaluation 
of 1954 field trial of poliomyelitis vaccine: Summary Report." 
Poliomyelitis Vaccine Evaluation Center, University of 
Michigan, April 12, 1955.) 

[44] Cochran, William G.; Hosteller, Frederick; Tukey, John W. 

Statistical Problems of the Kinsey Report . American Statisti- 
cal Association, 806 15th St., N.W., Washington, D. C. 20005, 
1954. 

[45] Coleman, James S.i et al. Equality of Educational Opportunity . 
Washington, D. C, U. S. Government Printing Office, 1966. 
(A set of Correlation Tables, separately bound, is also avail- 
able for the use of research workers.) 

[46] Cutler, S. J. "A review of the statistical evidence on the 

association between smoking and lung cancer." Journal of the 
American Statistical Association . 50 (1955), pp. 267-83. 

[47] Heemiann, Emil F. and Braskamp, Larry A. Readings in Statistics 
for the Behavioral Sciences . Englewood Cliffs, New Jersey, 
Prentice-Hall, Inc., 1970. 

[48] Kinsey, A. C; Pomeroy, W. B.; Martin, C. E. Sexual Behavior 
in the Human Male . Philadelphia, Pennsylvania, W. B. Saunders 
Company, 1948. 

[49] Mosteller, Frederick, e^al., eds. Statistics by Example . 
Part III, Detecting Patterns . Reading, Massachusetts, 
Addison-Wes ley Publishing Company, to appear in 1973. 

[50] Mosteller, Frederick, et al., eds. Statistics by Exam_£le . 
Part IV, Finding Models . Reading, Massachusetts, Addison- 
Wesley Publishing Company, to appear in 1973. 

[51] Moynihan, Patrick. The Negro Family: The Case for National 

Action . Washington, D. C, U. S- Government Printing Office, 
1965. Reprinted in Rainwater, Lee and.Yancy, William L. 
The Moynihan Report and the Politics of Controversy . 
Cambridge, Massachusetts, MIT Press, 1967. 

[52] Peters, William. Readings in Applied Statistics . Englewood 
Cliffs, New Jersey, Prentice-Hall, Inc., 1969, 

[53] Report on Lung Cancer. Smoking, and Health . Public Health 

Bulletin 1103, Suptjr intendent of Documents, U. S. Government 
Printing Office. 
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[54] Steger, Joseph A., ed. Readings in Statistics for the 

Behavioral Sciences . New York, Holt, Rinehart and Winston, 
Inc., 1971. 

[55] Tanur, Judith, al., eds. Statistics: A Guide to the 

Unknown. San Francisco, California, Holden-Day, Inc., 1972. 

[56] "The Cochran-Mosteller-Tukey Report on the Kinsey Study: 

A Symposium." Journal of the American Statistical Association 
50 (1955), p. 811. 

[57] Tufte, Edward R. The Quantitative Analysis of Social Problems 
Reading, Massachusetts, Add ison-Wesley Publishing Company, Inc 
1970. 



35 



V. USE OF DATA SETS 



The use of prob lem material involving real data in teaching the 
introductory course in statistics overcomes some of the recognised 
defects of the traditional systematic course. By focusing attention 
on problems involving data which have intrinsic interest [or the 
student, it is possible to intiMv' ^ important statistical ideas and 
concepts in a context that v ii i to facilitate studetU under- 
standing. Use of examples and cases i 'om real life can also be of 
great help in motivating students. Further, they can serve as 
vehicles for illustrating ihe appUcat: n of statistical concepts 
and method's in a variety of -settings. 

Data sets useful for the introductory statistics c6urse can be 
small or large. Small data sets can be extracted from investigations 
in a variety of fields (e.g., sample surveys of voters; or consumers, 
federal statistical reports, annual business reports, and the likeK 
or they can be generated by various class experiments or investiga- 
tions. They are characterized by limited amounts of data suitable 
for illustrating a particular statistical concept or technique. An 
example is the annual earnings of a company during the past ten years, 
which might be used for comparing average earnings in the first five 
years with those in the second five years. 

Large data sets are characterized by large volumes of inter- 
related data. For example, a data set on voting behavior may contain 
information about a variety of personal characterist ics of tht. voter 
(e.K. age. sex, income, education, marital status, attitudinal data; 
as well as a variety of voting behavior (e.g., voting behavior in 
elections during the past five years at national, state local 
levels). Another example of a large data set is medical information 
about a segment of the population (e.g. age, sex height, ^^-^^^l' . 
blood pres^re, cholesterol level, etc.). Large data sc s ar. ofUn 
available on tapes and can be stored in local computers for ea:;^ ol 
access by students. 

For the introductory statistics course that features a system- 
atic development of statistical concepts, large and small '^'J^a sets 
are used in essentially similar fashion. For example, to l U.strate 
the construction of a confidence Interval, one might ..so data on 
consumer food expenditures or on blood pressure of P^^ients. These 
data could be given to the student In the form o a small data set, 
or he could be asked to perform a limited task of analysis with 
these data. (This is in distinction to the use of large data sets 
as a means of developing understanding of statistical concepts 
unsystematically in a problem-oriented fashion.; 

Use of problem material based on real data sets requires that 
the instructor devote class time to discussion. The setting of tUo 
problem should be discussed Initially so that students understand it 
clearly. After the statistical analysis has been completed, the 
meaning and interpretation of the results should be discussed, as 
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well as any further analyses that might be required for investigation 
of the problem. 

The use of data sets is not restricted to illustrating the 
application of particular statistical methods. They can also be used 
as a meaningful vehicle in sampling experiments. The data set for 
this purpose would be viewed as a population, and repeated samples 
would be selected from it by a table of random numbers or by compu er. 
An advantage of this use of data sets over sampling from artificial 
populations is that real data sets permit the students to int^^P^^^ 
the results more meaningfully. For example, the demonstration that 
the sampling distribution of the sample mean becomes more concen- 
trated with increasing sample size is more meaningful for many stu- 
dents when they can interpret the numbers involved in real terms, 
e.g.," as incomes or blood pressures. 

The use of data sets requires computational effort. Although 
we strongly believe that the use of real data sets adds a valuable 
dimension to the introductory statistics course, we also strongly 
believe that students should not engage in computational drudgery. 
Consequently, adequate computational facilities need to be provided 
if large data sets are to be employed. If these ^^^l^^^^^/f . 
available, small data sets with simplified numbers should be employed. 

Experience suggests that students find data sets most interest- 
ing when they come from an area of interest to them. Thus, if the 
introductory statistics course is taught in a number of sections, it 
would be desirable to set up one or more sections for social science 
students, one or more sections for physical science students, and one 
or more sections for biological science students. Cases, examples, 
and data sets from these subjects can then be used so ^^^^^ . ^^"^"^^^"^^^^ 
will be motivated by illustrations from situations with which they are 
familiar. If the introductory statistics course is taught in only one 
section, examples and cases should be selected that are simple and 
easy to understand by most of the students in the class. 

Data sets can be obtained from diverse sources. One major 
source, containing demnr,raphic , sociological, economic, and many 
other kinds of data is; 

[58] S^.M'.^ical Ab^^rnc. oF the United States . 1970. U S. Bureau 
of the Census, Washington, D. C, U. S. Government Printing 
Office, 1970. 

Data on consumer behavior and voting preferences, and other 
types of sample survey data are available from various survey research 
centers. A list of sources for such data sets is: 

r591 Snri^l Science Data A rchives in the United States, 1967. 
^ ^ Council on Soc ial Science Data Analysis, 605 West 115th Street, 
New York 10025. 
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Three forthcoming books, sponsored jointly by the National 
Council of Teachers of Mathematics and the American Statistical 
Association, contain a wealth of statistical examples and applica 
tions: 

[60] Mosteller, Frederick, eds. Statistics by Example . 

Part III, Detecting Patterns . Reading, Massachusetts, 
Addison-Wesley Publishing Company, to appear in 1973. 

[61] Mosteller, Frederick, e^aj^., eds. Statistics by Example , 
Part IV, Finding Models . Reading, Massachusetts, Addison- 
Wesley Publishing Company, to appear in 1973. 

[62] Tanur, Judith, et al. ^ eds. Statistics; A Guide to ^ 

Unknown . San Francisco, California, Holden-Day, Inc., 1972 

In addition to using data sets furnished by the instructor, 
students can obtain data sets of their own from their particular 
field of interest, or the entire class can develop data by class- 
organized demonstrations and experiments (see Section VII) or by 
surveys conducted by members of the class. 



VI. USE OF COMPUTERS 



A computer can serve three broad roles in the implementation of 
the goals of an introductory statistics course. It can: (l) clarify 
certain key ideas of the course, (2) perform routine numerical calcu- 
lations, and (3) facilitate more active student participation in the 
development of statistical concepts. Each of these roles is illus- 
trated below. The question of whether a student should learn com- 
puter programming inevitably arises in discussions of the role of 
computers in education. It is this Panel's view that so much is 
demanded in the ordinary introductory statistics course, that the 
taking of additional time to teach programming is not justified. 
This Panel does not feel that the learning of programming will enable 
the student to obtain sufficiently greater analytical skills to 
warrant taking this time away from other topics. There may be 
reasons in the context of a student's entire curriculum for his being 
taught programming. If so, a decision must be made in the context of 
the curriculum as to which course should contain the teaching of 
programming. 

We turn now to illustrations of the various ways in which com- 
-puters~can be used to clarify important statistical concepts. The 
long-run relative frequency interpretation of probability can be 
illustrated by having a computer repeatedly simulate an experiment 
which results in "success" or "failure" on each trial and print the 
relative frequencies of success after 10, 20, 30, ... trials. The 
experiment should not be such a trivial one that students can find 
the probability by the examination of a few equally likely outcomes. 

One of the primary objectives of this introductory course is 
to introduce students to the notions of variability and uncertainty; 
these concepts can be illustrated in a number of ways on the com- 
puter. The notion of a confidence interval, for example, can be 
brought to life with a computer. A large number of 807„ confidence 
intervals obtained from samples of size 20 from a binomial distribu- 
tion with p = 0.6 are easily obtained on a computer and the propor- 
tion of intervals containing 0-6 determined. The confidence level 
should be low enough so that students will see cases where p - 0.6 
does not lie within the interval. Tliis demonstration can be linked 
to the testing of statistical hypotheses and can provide a sound 
basis on which to discuss that topic. 

Properties of estimators can also be studied on the computer 
by obtaining sampling distributions of estimators, e.g., distribu- 

„r ^(x-x)^ ^{^'Vl Z^^-V^ for fairly small n, to illus- 
tions ot ^ , n-1 * n-2 

trate what is meant by an unbiased estimator. Variances of different 
estimators also can be studied by examination of sampling distribu- 
tions generated by the computer. 
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An additional benefit can result from the use of random number 
generators in an Introductory course. The necessity of knowing that 
pseudo-random digits generated by a computer possess characteristics 
expected of random digits presents an opportunity to introduce the 
study of statistical tests such as the chi-square test and tests of 
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A second role of the computer in an introductory statistics 
course is to perform routine numerical calculations that are required 
in the analysis of problems. This Panel believes that the computa- 
tional aspects of the subject should be held to a minimum, consis- 
tent with the clarification of statistical ideas and princaoles and 
with the motivation of students by the introduction of interesting, 
contemporary problems. If an analysis of a situation that interests 
an instructor and his class requires computational assistance, then 
by all means some computational aid should be used, whether it be 
from an electronic computer or a desk calculator. Students expect a 
course to contain a touch of realism, and they are frequently dis- 
appointed if they do not attain some experience with hand 1 ing large 
amounts of data. Students should learn the procedures for calling 
up a statistical package because that knowledge is often used by 
those who analyze data. Three widely used statistical packages are: 

[63] Dixon, W. J., ed . Biomedical Computer Programs. University of 
California Publications in Automatic Computation #2, Second 
Edition. Los Angeles, California, University of California 
Press, 1970. 

[64] Hogben, David, et al. QMNTTAB II User's Reference Manual . 
NBS Technical Note 552, U. S. Department of Commerce. 
Washington, D. C, U. S. Government Printing Office, 1971. 

[65] Nie, Norman H., et al. Stnuistical Package for the Social 
Sciences . New York, McGraw-Hill Book Company, 1970. 

Even when major reliance for computation is placed on a large 
electronic computer, there are occasions when the understand ing of a 
concept or a computational technique requires that students perform 
computations on a desk calculator or by hand. One or two ^^^"P^^ 
problems illustrating the Student t-test, for examp le , should "q"^" 
students to calculate sample variances. Experience indicates that it 
is unwise to assume that students always understand what computations 
are required with raw data and know that statistical analysis is not 
always based on large amounts of data requiring the use of a computer. 

A computer can also serve instructors who wish to breal^ away 
from presenting all the ideas of the course through forma lectures . 
We refer to this third function of computers as their interactive 
role. For example, the instructor need not lecture students as to 
what constitutes a "large" sample in order to be able to apply the 
Central Limit Theorem; instead an empirical investigation can be 
undertaken. First, the instructor can have the students guess mini- 
values of n fo; which sample means tend to be normally distributed 
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when sampling from a numbor of populations with different character 
istics. The computer can then be used to generate sampling d^^"^" 
butlon^ of sample means for different sample sizes, thereby providing 
a basis for refined estimates of minim™, n and ultimately enhancing 
the students' understanding of the Central Limit Tl,eorem ^"^ the 
degree to which the shape of the population density and sample sze 
affect the shape of the sampling distribution. Working with ^^'^ °f 
these kinds, students usually raise new questions. In the case cited, 

tudents naturally want to know how to decide whether '^-r -mp ing 
distributions are nonnal, and the instructor has "'%7° J""^ 
a new investigation or at least a mention of Inferential problems 
Another way of encouraging student participation through interac ion 
with the computer is in the selection of n and a to obtain ^ 
able power curve for testing hypotheses about binomial p. Students 
also can be asked to select those Independent variab es i" ^ of 
variables which are Important in a regression analysis; 
in most colleges and universities can provide the Instructor with 
suitable data for this purpose. 

The Interactive role of the computer is enhanced by the exist- 
ence of terminals and a sufficient number of screens in the ^lass- 
roo^, but this equipment is not essential. Students can be required 
to mke investigations of the sort illustrated above as homework 
exercises using the available computer facility. 

In the use of a computer In any of Its three functions, it is 
desirable to give the student a feeling of control over the opera- 
tions of the computer. This can be done "qu r ng the student 
to specify parameters, desired output, and the ike. For 
in a sampling experiment the student might specify the P°P"l^tion to 
be sam^ed, the sample size, and the number of trials, as well as 
the "ture of the output (e.g., frequency distribution, histogram). 
Some students also benefit by writing simple programs using sub- 
routines of basic statistical operations. 

Tl,e printout of a c^puter run will be of Interest to the stu- 
dent to the extent that he is interested In the original problem. 
Hence our earlier conrn-ents on the nnportance of interesting and 
meaningful data sets are equally relevant whether the calculations 
performed on a computer or by the student. 



are 



Even when a computer Is not available, students ""/^^^ . . . 
realize some of its benefits. For instance, an instructor can obtain 
a comp!etrset of computer printouts for his students. Students can 

s thl: set'f printouts in the same fnshion as ^ l^^-^^/^ -n- 
At appropriate times the Instructor can refer to one °f .'^'^^ P"'^"""" 
and explain how a particular analysis is carried out with the com- 

u e^'ex lain the' types of information given on the c-P^te^ p nt- 
out, and indicate how this Information would be "^^"^ J°^, 
rhp data In this way the students can obtain some of the benefits 
of learning how a computer can assist In statistical analysis and 
a so obtain cZputer illustrations of some of the basic stat stical 
concepts such as sampling distributions without actually having 
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access to a computer. Dixon discusses the use of a "side inch" of 
computer printout in [76]. The "side incli" can be obtained for $3.00 
by writing to Professor W. J. Dixon, Department of Bioinathematics , 
School of Medicine, University of California, Los Angeles, California 
90024. 

The use of computers In teaching introductory statistics can be 
expensive. In addition to the costs of the equipment, the use of 
computers requires much planning by the instructor, as well as sub- 
stantial monitoring during the course. A modern progrannnable mini- 
computer provides a relatively inexpensive way of performing a wide 
variety of statistical operations. 

The impression has been gained by many instructors using com- 
puters in teaching introductory statistics tliat their use is of 
interest to students and motivates them. Despite their wide use, 
however, only limited formal evaluation of the effectiveness of 
computers in the introductory statistics course has been carried out 
to date. Undoubtedly, the coming years will provide important infor- 
mation on the best way in which computers can be used in introductory 
statistics courses as well as on their cost-effectiveness as teaching 
and learning devices. 

None of the above mentioned uses of computers are to be con- 
fused with computer-assisted instruction . Tliis method of instruction 
is expensive for use in the introductory course and, wlien compared 
with a well written programmed learning text, it may not be econom- 
ically justified at this time. That is not to say, liowever, that 
technology will not advance sufficiently far in the next few years 
to make computer-assisted instruction an important alternative to 
existing modes of instruction. 

Selected References : 

[66] Buford, Roger L, Statistics: A Computer Approacli . Columbus, 
Ohio, Charles E. Merrill Publishing Company, 1968. 

[67] Carmer, S, G. anJ Cady, F. B. "Computerized data generation 

for teaching statistics." The American Statistician 23 (1969), 
pp. 33-35. 

[68] Computers in Undergraduate education: Matlicma t ics , Physics . 
Statistics, and Cliemistry . Proceedings of a Conference 
sponsored by the National Science Foundation and conducted at 
the Science Teaching Center of tlic University of Maryland, 
College Park, 1967. 

[69] Conference on Computers in the Undergraduate Curricula . 

Dartmouth College, Hanover, New Hampshire, 1971. The following 
articles : 

1, "Use of computers in statistical instruction," Richard 
N, Schmidt, pp. 437-443. 
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6. "Computer-assisted teaching of experimental design: The 
development of a ^Master Experimenters' Program," 
Albert R. Gilgen and Michael A, Hall, pp, 2.39-2.46. 

Reviev of the International Stati stical Institute 
(2 Oostduinlaan, The Hague, Netherlands), Vol. 39, 
Number 3 (1971). The following articles: 

1. "Notes on available materials to support computer- 

based statistical teaching," W. J. Dixon, pp. 257-286, 

2. "Side Inch," W, J, Dixon, pp, 315-339. 

3. "On using a conversational mode computer in an inter- 

mediate statistical analysis course," D, Quade, 
pp, 343-345. 

A. "Development of materials and techniques for the instruc- 
tional use of computers in statistics courses," D, Quade 
pp. 361-362. 

5, "Survey sampling in a computerized environment," 
T. E, Dalenius, pp. 373-397. 

Schatzoff, Martin, "Application of time-shared computers in a 
statistics curriculum." Journal of the American S tatistical 
Association . 63 (1968), pp. 192-208. 

Sterling, T, and Pollack, S, "Use of the computer to teach 
introductory statistics." Communication of the Association 
of Computing Machinery . 9 (1966), pp* 274-276. 



VII. EXPERIMENTS. SIMULATIONS. DEMONSTRATIONS. AND TEACHING AIDS 

Since planning of experiments and analysis of actual data are 
.ajor concerns of most practicing statisticians it would seem hat 

ioht use relatively simple experiments to develop basic sta 
tisticfl concept to obtain data for future analysis, and to give 
s^e exLrience designing an experiment. There are arguments 
a^inst this approach. It can use up a considerable amount of time 
for the individual student, for the class, and especially for the 
teacher. I can sometimes be frustrating. The arguments ior such 
an approach center about the personal involvement of the student, 
his increase in interest, and his discovery of important Pr-ciples 
nr relationships. There is considerable evidence that such an 
"proLh can be uccessful. Practically all of the basic tra ning 
courses in statistical quality control used experunents and demon- 
strations to introduce statistical concepts, and these uses were 
judged successful. Two helpful references on these uses are. 

n<)l Olds E G. and Knowler. L. A. "Teaching statistical quality 

cont;ol fo; town and gown." Journal of the American Statistical 
Association . 44 (1949). pp. 213-230. 

[80] Scherwin. R. L. "Teaching aids for statistics and q^^lity 

control." TnHMstrial Quality Control . 23 (1967). pp. 654-660. 



1. Demonstrations and Ver if Experiments 

For our purposes we would like to distinguish among several 
• Tho firsr tvpe we shall designate as a 

types of experiments. The tirst typt wt o the 

"demonstration." The student is given an assignment for "hich the 
instructor has the theoretical solution. If the « ^"^^^^ 

oMPsses the expected outcome, then this approximates the typical 
high school science experiment which simply illustrates a law stated 
or derived in the text book. Requiring students to toss a coin 100 
time n re'co d the total number of heads would be a typical demon- 

:»:tion. The students know that ^'-^P'^-^^ ^^^Lt S^h d an 
most of them also know that one does not really expect 3U 

50 tails. 

An assignment that the student count the number "^^^ °f 

"'-r'^ ftMi 'ufti! ^ii-terdigit: : : i".: 

of" x^e ilnL^^The-i^str^^lo^tVit^ his knowledge --"^^ 
distribution and the theorems on sums of independent random varia 
bl may know the mean and variance of the two ''^l5^^^3"t^,^:rt"does 
also may know that the distributions are skewed. The ^tudent does 
nnr have this knowledge and in this first course is unlikely to 
^cquirl i ' To the sLdent this assignment is a venture into the 

such as this a "verification experiment. 
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There are many iemoitstrations and verification experiments 
from whicli the students may discover or better understand basic 
statistical concepts. Tlie student might be asked to toss a coin 64 
times, recording his results (0 or 1) in a 4 by 16 table, and to find 
tlie average for each column, for each row, and for tlie entire table. 
These results could be used to justify statements about the distri- 
bution of the sample mean as n increases, Tlie student might be asked 
to draw samples, using a sampling paddle, from a box of beads or 
balls of at least two different colors. Bowls of numbered chips 
might be used, made up to represent different distributions, eitlier 
of different types such as rectangular, triangular, exponential, and 
normal, or of one type with different parameters. The student miglit 
draw small samples from a population, construct a confidence interval 
for each sample, and determine the proportion of confidence intervals 
which include the population mean or proportion. In general, the 
distribution of any sample statistic might be motivated by a demon- 
stration or experimental verification. To a great extent, the value 
of such activities depends upon the student's interest and enthusiasm. 
In any case, tlie activities should be used with moderation. 

Se lectcd References : 

Berkeley, Edmund C. Probability and Statistics - An Intro - 
duction Through Experiments . New York, Science Materials 
Center, 1961. This book describes some 27 experiments. 
It is written to accompany a kit. 

Dixon, Wilfrid J. and Massey, Prank J., Jr. Introduction to 
Statistical Analysis . New York, McGraw-Hill Book Company, 
1969. Most chapters have a set of class exercises based on 
random number tables, bead drawings, etc . 

Harrison, R. D. "An activity approacli to the teacliing of 
statistics and probability." (in three parts) Matiicmatics 
Teaching , 34 (1966), pp. 31-38; 35 (1966), pp. 52-61; 
36 (1966), pp. 57-65. 

Malpos, A. J. Experiments in Statistics . Edinburgh, 
Scotland, Oliver and Boyd, Ltd., 1969. 



Open Experiments 

An "open experiment" is quite difffrcnt frnni a demons t ration or 
an experimental verification. Neitlicr tlie instructor nor the student 
is able to predict the outcome. As an extreme exami-jjc, lot us con- 
sider a different version of tlie coin-tossing demonstration. llie 
c la ss , in some manner unknown to tlie instructor, will split into two 
groups of equal size. Each member of tlie first group will actually 
toss a coin 100 times and record the outcomes (0 or 1) in order . 
Each member of the second group will write out a sequence of 100 
numbers (0 or 1) without tossing a coin, in such a fnsliion that the 
sequence , in his op in ion , s imu la tes the results of ac tua I coin 
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tossing. Using statistical tests (which may be developed over the 
term), the instructor will attempt to identify in which group each 
sequence belongs. The teacher might classify a sequence as group 
two if the results come too close to 50-50, or if there are too many 
runs, or if the longest run is suspiciously small, or if the cumula- 
tive fraction of heads stays too close to n/2 . But now the experi- 
mental situation is completely reversed; the students know the 
answers and the teacher is the discoverer. 

Actual classroom experiments of the open type can cover a wide 
range of difficulty. A relatively simple one is to ask the class the 
probability of getting a head on a coin if the coin is spun instead 
of tossed. First, one must specify the essential conditions. Wliat 
kind of coin? How long a spin? If the coin is spun by holding it 
with the finger of one hand and flicking it with a finger of the 
other hand, does the initial position of the coin make a difference? 

Some apparently simple experiments can si-ddenly develop con^nU- 
cations. Consider the experiment of empirically determining the 
approximate probability that a tlmmbtack will fall point up. Obvi- 
ously one must first specify at least the particular make of thumb- 
tack. But does one need to specify the type of surface it falls on? 
And can one speed up the experiment by taking ten tliumbtacks in a 
container and shaking them up? In one class, two students shook the 
thumbtacks in a china cup with a gentle lateral motion and then 
poured them on a table. Result— almost 100% points up! At this 
point another student decided to investigate the effect of different 
grades of sandpaper for tlie receiving surface and discovered an 
interesting regression problem. 

An open experiment that can display individual differences is 
the "coin shove" experiment (see [86j, p. 12). On some smooth poster 
board 30 inches long, draw a target line (designated 0) approximately 
6 inches from one end. Also draw lines an inch apart (designated +1, 
+2, -1, -2, ...), parallel to the target line. Then draw a 

starting line approximately 6 inches from the otlier end of the poster 
board. A trial of this experiment consists of shoving a coin from 
behind the starting line so that it stops as close to the target line 
as possible. The purpose of the experiment is to study the frequency 
distribution of scores tl\at result from n repeated trials. Many 
questions can be investigated: Is there a significant improvement 
in tl\e scores if 5 practice t;:ials ove allowed? Is there a signifi- 
cant difference between the abilities of individuals? Is it reason- 
able to assume independor^t trials? Can the scores of individuals be 
improved by allowing the use of a slingshot-type coin shooter? At 
what value of n is student interest replaced by boredom? 

Se lec ted References ! 

[85] "Interim Report of the R. S. S. Committee on the Teaching of 
Statistics in Schools." Journal of the Roya l Statistical 
Society . Series A, 131 (1968), pp. 478-497. 
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[86] Jowett, G, H. and Davies, H. M. "Practical experimentation as 
a teaching method in statistics." Journal of the Royal 
Statistical Society , Series A, 123 (1960), pp. 10-35. 

[87] Hosteller, Frederick, et al. Probability with Statistical 

Applications . 2nd ed. Reading, Massachusetts, Addison-Wesley 
Publishing Company, Inc., 1970. Manual describes a variety of 
experiments, demonstrations, and teaching aids. Pages 449 to 
454 of the text suggest a set of projects for highspeed 
computers . 

[88] Rade, Lennart, ed. Tlie Teaching of Proba bility and Statistics. 
New York, John Wiley and Sons, 1970. 



3. Simulations. 

Another type ot laboratory experience might be classified a 
"simulation." Here there may exist a theoretical solution to the 
problem but it may not be at the competence level of the class. 
One exaiiple might be a simplified epidemic where each day 20 persons 
line up in random ordei . Suppose that of the n = 20 persons, x = 2 
persons are contagious, y - 3 persons are immune, and z - 15 are 
susceptible. A susceptible person who stands next to a contagious 
person catches the disease. The duration of the disease is one day, 
so that a contagious person is immune the next day. To simulate the 
epidemic shake a container having two red beads labeled C for con- 
tagious, three yellow beads labeled I f>:>r immune, and 15 white beads 
labeled S for susceptible and pour the beads in a trough or a long- 
stemmed funnel. (A computer may be used instead of beads.) Suppose 
the result for the first trial is: 

SSCSSICSSISSSSSISSSS 

Then on the next trial we would have three infectious P^"0"S 
(places 2, 4, 8), five immune persons (places 3, 6, /, 10, 10), and 
12 susceptible persons. Variables which might be investigated are 
the number of trials until the epidemic is ended, the number of 
susceptibles left at the end of the edpidemic, and the largest 
number of contagious persons at any time. The simulation study can 
be enlarged by investigating the behavior of the epidemic for various 
values of x, y, and n. 

Another simulation is the server problem. Customersarr ive at 
integral valuesof time t from 1 to n (for example, let n - 50). ine 
probability of a customer's arriving at any time t is a constant p 
(for example, p = 1/5). The service time for a customer is a con- 
stant c less than 1/p (for example, c = 4). At the end of n time 
intervals the gates are closed but the customers in line must still 
be served and of course the persons serving them must be paid over- 
time. For equipment one can use a die, a pack of playing cards, a 
table of random digits, or a computer. The first decision that needs 
to be made concerns what data to record. After one class tried the 
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experiment, they decided that they should record; number of arrivals, 
total service time, idle time, overtime, sum of the delay times, ^^and 
cn of squares of delay times. This last number they named the riot 



sum 
index 



Films 

A number of films pertaining to probability, statistics, and 
quality control are available. Of those known to the Panel, the 
film "Random Events" of the PSSC Physics Series seems most suitable 
for the kind of course we are considering. 



Selected Films ; 

1. Probability and Statistics 
25 minutes B & W 1957 

2. Mathematics and the River 
19 minutes Color 1959 
Horizons of Science Series 

3. Probability and Uncertainty 
56 minutes 1965 

4 . Me an -Med ian -Mod e 

13 minutes Color, B & W 
1966 

5. Probability 

12 minutes Color 1966 



ASSN Films 

3A7 Madison Avenue 

New York, New York 10036 

Educational Testing Service 
20 Nassau Street 
Princeton, New Jersey 08540 

Educational Service, Inc. 
AO Galen Street 

Watertown, Massachusetts 02172 

McGraw-Hill Text Films 
330 West A2nd Street 
New York, New York 10018 

McGraw-Hill Text Films 
330 West A2nd Street 
New York, New York 10018 



6. Matter of Acceptable Risk 

30 minutes B & W 1967 

7. Random Events 

31 minutes B & W 1962 
PSSC Physics Series 

8. How's Chances 

30 minutes B & W 1957 
Westinghouse 

9. It's All Arranged 

30 minutes B & W 1957 
Westinghouse 

10. Photons 

19 minutes B & W 1960 
PSSC Physics Series 



Indiana University 
Audio-Visual Center 
Bloomington, Indiana 47401 

Modern Learning Aids 
315 Springfield Avenue 
Summit, New Jersey 07901 

Assoc iation Films 

347 Madison Avenue 

New York, New York 10017 

Association Films 

347 Madison Avenue 

New York, New York 10017 

Modern Learning Aids 
315 Springfield Avenue 
Summit, New Jersey 07901 
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Predicting Through Sampling 
10 minutes Color 1969 



Bailey Films Associates 

11559 Santa Monica Blvd. 

Los Angeles, California 90025 



12. 



The Probabilities of Zero 

and One 
11 minutes Color 1969 



Bailey Films Associates 

11559 Santa Monica Blvd. 

Los Angeles, California 90025 



13. 



Probability, an Introduction 
9 minutes Color 1969 



Bailey Films Associates 

11559 Santa Monica Blvd. 

Los Angeles, California 90025 



Visual Aids and Other Materials 

There are available a variety of visual aids and other helpful 
materials. Various manufacturers of games offer large dice, roulette 
wheels, cliuck-a-luck cages, etc. Biased and mlsmarked dice are 
available, although it is sometimes difficult to locate a source. 

Selected sources : 

a. Lightning Calculator Company, Box 6192, St. Petersburg, 
Florida 33736. 

1. Quincunx or Galton Board . A device for generating a 
binomial or normal distribution, Tliis model features an 
adjustable outlet which enables one to shift the popula- 
tion mean, a sliding control whicli enables one to drop 
from one to five beads at a time, and a control for 
examining small samples before 'hey are accumulated into 
a large sample; completely se 1 f -ctnc losed so that the 
beads cannot drop out. 

2. Sampling Demonstrators . Consists of six different colors 
of beads, plastic container, and sampling paddles. Avail- 
able in two different models, one witli 2000 beads and 
three sampling paddles, a second witli 1000 beads and two 
sampling paddles. 

3. Control Chart Simulator , Device consisting of various 
distribution patterns, dowel rods for indicating limits 
of variability, etc., and frame. Reverse side lias set 

of horizontal wires with beads to demonstrate observations 
over time, either individual or grouped. 

b. Ray R. Lilly, 30 Lilly Road, Wanaque, New Jersey 07A65. 

1. Sampling demonstrators, plastic balls in various colors and 
lot sizes, sampling paddles. Available in different models 
or to specification. 
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2, Demonstration Board . One side consists of various models 
for distributions, with templates (attachable) to show 
distribution of average for n « 5 and n = 20. Also a 
model to show change in variability. Dowel rods show 
specification limits, control limits, modified control 
limits, etc. Reverse side consists of one set of hori- 
zontal wires for distribution over time of either 
individuals or subgroups, plus overlay set of wires to 
demonstrate distribution of medians. 

3, Three-dimensional models . One consists of a peg-board 
with plastic rods and beads to demonstrate multivariable 
control charts, bivariate distributions, etc. A second 
has a set of sliding channels with pegs, which can be used 
to demonstrate correlation, regression, etc. 

c. E. S. Lowe Company, Inc., 200 Fifth Avenue, New York, New York 
10010. Manufacturer of games and accessories. Items such as 
large dice (up to 4 inches), roulette wheels, bingo games, 
chuck-a-luck, miniature slot machines, etc. 

d. Hunter Spring Company, Lansdale, Pennsylvania 19446. Normal 
frequency distribution template. For use in illustration 
work. Small template with o = 10 mm. 

e. Tell Manufacturing CoTipany, 200 South Jefferson Street, Orange, 
New Jersey 07050* i^anufacturei* of plastic beads and balls in 
various size ranges from 6 mm to 23 mm diameter. Some 13 
different colors. Smaller sizes in units of 100. 

f. Walco Products Company, 37 West 37ih Street, New York, New 
York 10018. Manufacturer of wooden beads in various shapes 
and 3izes. Spherical beads come in siz'es from 3 tnm to 20 mm. 
Cylindrical and barrel shapes up to 1 inch in height. Small 
beads must be ordered in units of 1000, larger units of 100. 

g. Quality Service Foundation, Weena 700, Rotterdam, Netherlands. 

1, Polyhsdra numbered 0 fo 9 for generating random digits or 
selecting random samoies. 

2. Drafting, triangle with two normal templates for distribu- 
tion or individuals and distribution of averagt^^ (n = 5) 

h. Jopanesfc JJtandavds Association, Ginza Higashi 6-1, Chuo-ku, 
Tokyo, Japan. Icosahedron numbered 0 to 9 for generating 
random digits jr tor selecting random samples. 
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Course Organization 



Inclusion in the introductory statistics course of the varied 
motivational and instructional activities, such as the use of data 
sets, computers, sampling experiments, and films, is time-consuming. 
The instructor may therefore wish to add another class meeting each 
week to permit more extensive use of this pedagogy. 

One method of including these activities is by scheduling 
them in class when they naturally arise. An advantage of this 
approach is that the student can understand the activity in its 
context. A disadvantage is that many of the activities, such as 
sampling experiments, are time-consuming and therefore may disrupt 
the continuity of the overall development. 

Another approach is to schedule formal laboratory periods 
from time to time, during which these activities take place. Then 
the development of the course material is not disrupted, but the 
timing of events can not always be made to coincide with tlie class 
deve lopmen ts . 



Learning Resources Centers 

Demonstrations, verifications, experiments, and simulations 
require physical facilities and organization. The Panel has been 
encouraged to learn of various institutions that liave developed 
learning resources centers where students can listen to tapes, view 
films, find programmed material for remediation, carry out experi- 
mentsi and plan their own group investigations. Such a center pro- 
vides an opportunity for small group discussions both at the planning 
stage of an investigation and at the analysis stage. For some of the 
experiments discussed, such as the server problem or the epidemic 
problem, it is advisable to have students work in teams of two to 
four, with each team repeating tlie experiment a small number of 
times. The results can then be pooled. For other experiments there 
will need to be serious consideration given to the question of pool- 
ing. For the coin shove experiment, for instance, the question of 
pooling results will raise serious problems and can lead to a dis- 
cussion of individual and group differences. 

Organizing students into small groups to carry out investiga- 
tions can be an effective means of stimulating student interactions 
and can thereby aid the learning process. Student teams should be 
reasonably small so that each student can participate effectively. 
The teacher may meet with each team from time to time or be avail- 
able for assistance when a team requires it. 

Some learning resources centers have a time-shared console or 
are adjacent to a computation facility having such consoles. The 
Panel suggests that mathematics departments offering statistics 
courses consider the establishment of such a facility. 
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For convenience we collect here the references listed through- 
out this report. References [89] to [98] give additional resource 
material for instructors and students. 

PROGRAMMED INSTRUCTION IN STATISTICS 
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Boston, Massachusetts, Allyn and Bacon, Inc., 1970. 



ILLUSTRATIVE LIST OF TEXTS FOR AN INTRODUCTORY COURSE 

[5] Alder, Henry L. and Roess^er, Edward B. Introduction to 

Probability and Statistics . 4th ed. San Francisco, California, 
W. H. Freeman and Company, 1968. 

[6] Freund, John E. Modern Elementary Statistics . Englewood 
Cliffs, New Jersey, Prentice-Hall, Inc., 1967. 

[7] Guenther, William C Concepts of Statistical In ference. New 
York, McGraw-Hill Book Company, 1965. 

[8] Hoel, Paul G. Elc rnentary Statistics . 3rd ed . New York, John 
Wiley and Sons, 1971. 

[9] Huntsberger, David V. Elements of Statis tical Inference. 

2nd ed. Boston, Massachusetts, Allyn and Bacon, Inc., 1967. 

[10] Mendenhall, William. Introduction to Statistics . 2nd ed . 
Belmont, California, Wadsworth Publishing Company, 1967. 

[11] Walker, H. M. and Lev, J. Elementary Statist ical Methods. 
3rd ed. New York, Holt, Rinehart and Winston, Inc., 1969. 
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ILLUSTRATIVE LIST OF REFERENCES FOR AN INTRODUCTORY COURSE 



[12] Blackwell, David. Rnfllc Statistics . New York, McGraw-Hill 
Book Company, 1969. 

[13] Dixon, Wilfrid J. and Massey, F. J. Introduction to Statistical 
Analysis . 3rd ed. New York, McGraw-Hill Book Company, 1969. 

[14] Hodges, J. L., Jr. and Uhmann, E. L. Basic Concepts of 

Probability and Statistics , 2nd ed. San Francisco, California, 
Holden-Day, Inc., 1970. 

[15] Natrella, Mary G. Experimental Statistics . Handbook 91. U. S. 
Department of Commerce, National Bureau of Standards, 1966. 

[16] Neymann, J. First Course in Probability a nd Statistics. New 
York, Henry Holt and Company, 1950. 

[17] Savage, I. Richard. Statistics: Uncertainty a nd Beliavior. 
Boston, Massachusetts, Houghton Mifflin Company, 1968. 

[18] Snedecor, George W. and Cochran, W. G. Statistical Methods^ 
6th ed. Ames, Iowa, Iowa State University Pruss, 1967. 

[19] Wallis, W. Allen and Roberts, Harry V. Statistics; A New 
Approach . New York, The Macmillan Company, 1956. 



ON THE NATURE OF STATISTICS 

[20] Careers in Statistics . The Conimittee of Presidents of the 

American Statistical Association, tlie Institute of Mathematical 
Statistics, and the Biometric Society. The American Statistical 
Association, 806 15th Street, N.W., Washington, D. C. 20005. 

[21] Kruskal, William, ed . Mathematical Scienc es and Social 

Sciences. Englewood Cliffs, New Jersey, Prentice-Hall, Inc., 
1970. 

[22] Sills David L. , ed. International Encyclopedia of the Social 
Sciences . New York, The Macmillan Company and the Free Press, 
1968. Listings under: 
Statistics 

Statistical analysis 
Survey ana lys is 

[23] Tanur, Judith, et al., eds. Statistics: A Guide to the Unknown. 
San Francisco, California, Holden-Day, Inc., 1972. 

[24] The Mathematical Sciences: A Collection of Essays . Edited by 
The National Research Council's Committee on the Support of 
Research in the Mathematical Sciences (COSRIMS) with the col- 
laboration of George A. W. Boehm. Boston, Massachusetts, MIT 
Press, 1969. 



[25] Wallis, W. Allen and Roberts, Harry V. Stati|^ics^^_New 
Approach . New York, The Macmillan Company, 1956 . 

ADDITIONAL RESOURCE BOOKS 

r26l Fisher R. A. Statistical Mnthoda for Research Workers, 
13th ed. New York, Hafner Publishing Company, 1958. 

[27] Owen, Donald B. Handbook o£ Sratistical Tables, ^^^^^"8. 
Massachusetts, Addison-Wesley Publishing Company, 1962. 

SELECTED TEXTS AND REFERENCES FOR A DECISION THEORY COURSE 

[28] Aitchison, John, rhnice Against Chance: An Introduction to 
^ ^ statistical Decision Theory . Reading, Massachusetts, Addison- 
Wesley Publishing Company, 1970. 

[29] Chernoff, Herman and Moses, Lincoln E. Rlemonrary Decision 
Theory . New York, John Wiley and Sons, 1959. 

riol Hadley. G. Introduction to Probability and Statistical 

Dpcision Theory . San Francisco, California, Holden-Day, Inc., 
1967. 

[31] Lindgren, B. W. Elements of Dc^cision Theory. New York, The 
Macmillan Company, 1971. 

[32] Lindley, D. V. Mnkine Decisions . New York, John Wiley and 
Sons, 1971. 

[33] Raiffa, Howard, n^cision Analysis: Introductory Lectures on 
^ ^ Choices Under Uncertainty . Reading, Massachusettii , Addison- 
Wesley Publishing Company, 1968. 

n^l Schlaifer R. Probability and StatisMcs Cor Business 
t^^^ lt]l\i:l\ An iTTt^^H^.tinn to ManarPrial Economics U^ 
Uncertainty . New York, McGraw-Hill Book Company, 1959. 

ILLUSTRATIVE LIST OF TEXTS FOR A NONPARAMETRIC COURSE 

[35] Conover, W. J. Poetical Non p--— '"^^^^ Statistics. New York, 
John Wiley and Sons, 1971. 



[36] Kraft, Charles H. and van Eeden, Constance. A Nonpar ame trie 
^ Introduction to Statistics . New York. The Macmillan Company, 
1968. 

r37l Noether Gottfried E. Introduction to Statistics: A Fresh 
^ Approach . Boston, Massachusetts, Houghton Miftlin Company, 



1971. 
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OTHER SELECTED REFERENCES IN NONPARAMETRIC STATISTICS 



[38] Bradley, James V, Dlatrlbutlon-Free Statistical Tests * 
Englevood Cliffs, New Jersey. Prentice-Hall, Inc., 1968. 

[39] Gibbons, J. Nonparametric Statistical Inference . New York, 
McGraw-Hill Book Company, 1971, 

[40] Hajek, Jaroslav. Nonparametric Statistics . San Francisco, 
California, Holden-Day, Inc., 1969. 

[41] Noether, Gottfried E, Elements of Nonparametric Statistics . 
New York, John Wiley and Sons, 1967. 

[42 ] S lege 1 , Sydney • Nonparametric Statistics for the Behavioral 
Sciences . New York, McGraw-Hill Book Company, 1956. 



SEIZCTED SOURCES FOR CASES 

[43] Brownlee, K. A. "Statistics of the 1954 polio vaccine trials." 
Journal of the American Statistical Association , 50 (1955) 
pp. 1005-1014. (An invited address on the article "Evaluation 
of 1954 field trial of poliomyelitis vaccine: Summary Report." 
Poliomyelitis Vaccine Evaluation Center, University of 
Michigan, April 12, 1955.) 

[44] Cochran, William G.; Mosteller, Frederick; Tukey, John W. 

Statistical Problems of the Kinsev Report . American Statis- 
tical Association, 806 15th Street., N.W., Washington, D. C. 
20005, 1954. 

[45] Coleman, James S., e^ aj.. Equality of Edt;cational Opportunity . 
Washington, D, C, U, S. Government Printing Office, 1966. 
(A set of Correlation Tables, separately bound, is also avail- 
able for the use of research workers.) 

[46] Cutler, S, J, "A review of the statistical evidence on the 

association between smoking and lung cancer." Journal of the 
American Statistical Association . 50 (1955), pp. 267-83. 

[47] Heermann, Emil F. and Braskamp, Larry A. Readings in Statisti cs 
for the Behavioral Sciences . Englewood Cliffs, New Jersey, 
Prentice-Hall, Inc., 1970. 

[48] Kinsey, A. C; Pomeroy, W. B.; Martin, C. E. Sexual Behavior 
In the Human Male . Philadelphia, Pennsylvania, W. B. Saunders 
Company, 1948. 

[49] Mosteller, Frederick, ^ _aj, . , eds. Statistics by Example . 
Part III, Detecting Patterns . Reading, Massachusetts, 
Addison-Wesley Publishing Company, to appear In 1973. 
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Hosteller, Frederick, c_t a^t , eds. Statistics by Example ^ 
Part IV, Finding Models t Reading, Massachusetts, Addison- 
Wesley Publishing Company, to appear in 1973t 

Moynihan, Patrickt The Negro Faniilv: The Case for National 
Action * Washington, D. C,, U. S, Government Printing Office, 
1965* Reprinted in Rainwater, Lee and Yancy, William L* 
The Moynihan Report and the Politics of Controversy , Cambridge, 
Massachusetts, MIT Press, 1967* 

Peters, William* Readings in Applied Statistics * Englewood 
Cliffs, New Jersey, Prentice-Hall, Inc*, 1969* 

Report on Lung Cancer, Smoking^ and Health * Public Health 
Bulletin 1103, Superintendent of Documents, U. S, Government 
Printing Office. 

Steger, Joseph A., ed * Readings in Statistics for the 
Behavioral Sciences * New York, Holt, Rinehart and Winston, 
Inc*, 1971. 

Tanur, Judith, e^ aJL*, eds* Statistics: A Guide to the 
Unknown * San Francisco, California, Holden-Day, Inc*, 1972. 

"The Cochran-Mosteller-Tukey Report on the Kinsey Study: A 
Symposium* " Journal of the American Statistical Association . 
50 (1955), p. 811. 

Tufte, Edward, R. The Quantitative Analysts of Social 
Problems * Reading, Massachusetts, Addison-Wesley Publishing 
Company, Inc*, 1970* 



SOURCES FOR DATA SETS 

Statistical Abstract of the United States, 1970 * U* S, Bureau 
of the Census, Washington, D. C, U. S, Government Printing 
Office, 1970. 

Social Science Data Archives in the Un ; .! t;^tes, 1967 * 
Council on Social Science Data Analysis ^ f- West 115th Street, 
New York 10025. 

Moateller, Frederick, e_t al., eds* Statistics by Example . 
Part III, Detecting Patterns * Reading, Massachusetts, Addison- 
Wesley Publishing Company, to appear in 1973. 

Mosteller, Frederick, e_t _al., eds* Statistics by Example . 
Part 17, Find i ng >]odels . Reading, Massachusetts, Addison- 
Wesley P iblishing Company, to appear in 1973. 

Tanur, Judith, et al, , eds* Statistics: A Guide to the 
Unknown * San Francisco, California, Holden-Day, Inc., 1972. 
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STATISTICAL PACKAGES 



[63] Dixon. W. J., ed. Blonrpdlcal Con.p„rpr Prosrams . ""1^"^^'^ °^ 
California Publications in Automatic Computation #2 Second 

Edition. Los Angeles. California. University of California 

Press. 1970. 

[64] Hogben. David, et al. OMNITAD II User's Rorerence Manual. 
NBS Technical Note 552. U. S. Department of Commerce. 
Washington, D. C, U. S. Government Printing Office, 1^/1. 

[65] Nle. Norman H., etal. Statistical Packnf.P for the Social 
Sciences. New York. McGraw-Hill Book Company. 1970. 



SEI£CTED REFERENCES ON THE USE OF COMPUTERS IN TEACHING STATISTICS 

[66] Buford. Roger L. Sr-.ntistlcs: A Computer Approach. Columbus. 
Ohio. Charles E. Merrill Publishing Company. 1968. 

[67] Cramer. S. G. and Cady. F. B. "ComputerUed data generation 

for teaching statistics." rhn American Statistician. 23 (1969), 
pp. 33-35. 

[68] ^n^n„^prs in ItnHprgraduate E ducat ion: Marhnmarics, Physics , 
Sh.M.Hrs. and Chemistry . Proceedings of a Conference 
sponsored by the National Science Foundation and conducted at 
the Science Teaching Center of the University of Maryland, 
College Park. 1967. 

[69] rnnfprPn.P on Ccnnnuters In the ^l"^/ ; , i , _ 

•' Dartmouth College. Hanover. New Hampshire. 1971. The following 

articles : 

1, "Use of computers in statistical instruction," Richard N. 
Schmidt, pp. 437-443. 

2 "Inclusion of explanatory material In computer programs 

for statistical analysis." Jolayne Service, pp. 444-455. 

3 "STaXLAB. a simple programming system for the statistics 

laboratory." G. F. Atkinson, pp. 456-462. 

[70] npv.lonment o f Mn..rials and TPrhnigues for rhn Instructional 
U.. of Compute r, Statistics Courses. Department of 
Statistics. University of North Carolina. Chapel Hill, North 
Carolina, 1971. 

r7l1 Foster. F. G. and Smith, T. M. F. '"Hie computer as an aid in 
teaching statistics." Apnl , nH Statistics. 18 (1969), pp. 264- 



270. 
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[721 Freiberger. W. and Grenandor. U. A Shorr Co„rRP in Computn - 
^ ^ '"'"l IrobablUt y nnH S^atlBtlcs■ Applied Mathen,atical 

Sciences Volume 6. New York. Springer-Vorlag New York. Inc.. 



1971. 



p . u OP nr.^ Cnnlpv W. W. Introductory Stat iaticnl 

Ir^'^-es. P. R.^and^Cooley. W.^^.^^.^^_ ^ ^^^^^ ^^^^^ 

Sons, 1968. 

1. "Computer-assisted instruction in statistics." William W. 

Cooley. pp. 337-347. 

2. "Computers in the teaching of statistics: Where are the 

main effects?" David L. Wallace, pp. 349-361. 

3. "Time sharing and interactive statistics." P. M. Britt. 

et al., pp. 243-265. 

r75] P^n.^pHlnos nf - rnnfprence on Computers in rhP UnderRraduato 
^ Curricula . The University of Iowa. Iowa City, iowa. 1970. 

The following articles. 

1. "Use of computers in undergraduate statistics instruction." 

Mark I. Appelbaum and Donald Guthrie, pp. 2. 1-2. J. 

2. "The computer as an instructional tool for the statistics 

course." Young 0. Koh, pp. 2.2-2.17. 

3 "Using the computer in basic statistics courses." 

Richard L. Wlkoff. pp. 2.18-2.24. 

4 "Use of computers in teaching statistics to engineering 

students." Armit L. Goel. pp. 2.25-2.31. 

5, "SAMDS: A program to generate empirical sampling distri- 

butions of the mean." Henry G. Garrett. PP. 2.32-2.38. 

6. "Computer-assisted teaching of experimental design: The 

development of a 'Master Experimenters' Program 
Albert R. Gilgen and Michael A. Hall. pp. 2.39-2.46. 

r7fi1 Review of ^^ 1P InternaMnnal Stat i" -^M" cal Institute 
^''^ 72 Oos'tduinlaan. The Hague. Netherl ands). Vol. 39. Number 3 
(1971). The following articles: 

U "Notes on available materials to support computer-based 
statistical teaching." W. J. Dixon, pp. 257-286. 

2. "Side Inch." W. J. Dixon, pp. 315-339. 
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3. *'0n using a conversational mode computer in an intermediate 

statistical analysis course," D, Quade, pp, 343-345. 

4. "DevelopmenC of materials and techniques for the instruc- 

tional use of computers in statistics courses," D. Quade, 
pp. 361-362. 

5» "Survey sampling in a computerized environment," T. E. 
Dalenius, pp. 373-397 . 

[77] Schatzoff, Martin. "Application of time-shared computers in a 
statistics curriculum." Journal of the American Statistical 
Association, 63 (1968), pp. 192-208. 

[78] Sterling, T. and Pollack, S. "Use of the computer to teach 
introductory statistics." Communication of the Association 
of Computing Machinery , 9 (1966), pp. 274-276. 



ON THE USE OF EXPERIMENTS IN TEACHING i vTISTICS 

[79] Olds, E, G, and Knowler, L, A. "Teaching stacistical quality 
control for town and gown." Journal of the American Statis- 
tical Association . 44 (1949), pp. 213-230. 

[80] Scherwin, R, L, "Teaching aid for statistics and quality 

control." Indust:rial Quality Control . 23 (1967), pp, 654-660. 

[81] Berkeley, Edmund C, Probability and Statistics - An Intro - 
duction Through Experiments . New York, Science Materials 
Center, 1961. Ttiis book describes some 27 experiments. It 
is written to accompany a kit« 

[82] Dixon, Wilfrid J. and Massey, Frank J,, Jr. Introduction to 
Statistical Analysis . New York, McGraw-Hill Book Company, 
1969. Most chapters have a set of class exercises based on 
random number tables, bead drawings, etc. 

[83] Harrison, R, D, "An activity approach to the teaching of 

statistics and probability." (in thtec parts) Matliematics 
Teaching . 34 (1966), pp, 31-38; 35 (1966), pp. 52-61; 36 (1966), 
pp. 57-65. 

[84] Malpos, A, J, Experiments in Statistics . Edinburgh, Scotland, 
Oliver and Boyd, Ltd., 1969. 

[85] "interim Report of the R, S. S. Committee on tlie Teaching of 
Statistics in Schools." Journal of the Royal Statistical 
Society . Series A, 131 (1968), pp. 478-497. 

[86] Jowett, G, H. and Davies, H. M. "Practical experimentation as 
a teaching method in statistics." Journal oC the Royal 
Statistical Society . Series A, 123 (1960), pp. 10-35. 
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[87] Hosteller, Frederick, et al. Probabilit y with Statistical 

Applications . 2nd ed. Reading, Massachusetts, Addison-Wesley 
Publishing Company, Inc., 1970. Manual describes a variety of 
experiments, demonstrations, and teaching aids. Pages 449 to 
454 of the text suggest a set of projects for highspeed com- 
puters • 

[88] Rade, Lennart, ed. The Teaching of Probability and Statistics. 
New York, John Wiley and Sons, 1970. 



ADDITIONAL RESOURCE MATERIALS 

[89] Folks, LeRoy. "Some prior probabilities on the future of 

statistics." The American Statistician . 24 (1970), pp. 10-13. 
References cited in the Folks article: 

1. "Some aspects of the teaching of statistics." John Wishart, 

1939. JRSS, 102, pp. 532-564. 

2. "The teaching of statistics." Harold Hotelling, 1940. 

Annals of Hath. Stat ., pp. 457-471. 

3. "On the future of statistics." M. G. Kendall, 1942. 

JRSS, 105, pp. 69-91. 

4. "The teaching of statistics." Institute of Mathematical 

Statistics Committee on the Teaching of Statistics, 1948. 
Annals of Hath. Stat . ^ 19, pp. 99-115. 

5. "The teaching of statistics." John Wishart, 1948. 

JRSS, A, 111, pp. 212-229. 

6. "Why statistics?" P. C. Hahalanobis, 1948. Sankhya . 10, 

pp. 195-228. 

7. "The future of data analysis." J. W. TuVey, 1962. 

Annals of Hath. Stat .. 33, pp. 1-67. 

8. "On the future of statis tLcs--a second look." M. G. 

Kendall, 1968. JRSS . A, 131, pp. 182-194. 

[90] Kirk, Roger E., ed . Statistical Issues: A Rea der Cor the 
Behavioral Sciences . Belmont, California, Brooks/Cole 
Publishing Company, 1972. 

[91] Klein, Horris. Mathematics in Western Culture . New York, 

Oxford University Press, Inc., 1953. Tlie following articles: 

1. "The mathematical theory of ignorance: The statistical 

approach to the study of man," pp. 340-358. 

2. "Prediction and probability," pp. 359-375. 
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3. "Our disorderly universe; The statistical view of nature," 
pp. 376-394. 

[92] Mathematical Thinking in Beha vioral Sciences (Readings from 
The Scientific American ). San Francisco, California, W. H. 
Freeman and Company, Publishers, 1968. The following articles: 

1, "Chance," A. J. Ayer, October, 1965. 

2. "What is probability?" Rudolph Carnap, September, 1953. 

3. "Subjective probability," John Cohen, November, 1957. 

4, "Probability," Mark Kac, September, 1964. 

[93] Newman, James R-, ed . World of Mathematics . 4 vols. New York, 
Simon and Schuster, Inc., 1956. The following articles; 

Vol. 2, Part VII: The Laws of Chance 

1. "Concerning probability," Pierre Simon de Laplace, 

p. 1325. 

2. "The red and ♦'he black," Charles Sanders Peirce, p. 1334. 

3. "The probability of induction," Charles Sanders Peirce, 

p. 1341. 

4. "The application of probability to conduct," John 

Maynard Keynes, p. 1360. 

5. "Chance," Henri Poincare', p. 1380. 

Vol. 3, Part VIII: Statistics and the Design of Experiments 

1. "Foundations of vital statistics," John Graunt, p. 1421. 

2. "First life insurance tables," Edmund Ha Hey, p. 1437. 

3. "The law of large numbers," Jacob Bernoulli, p. 1452. 

4. "Sampling and standard error," L. C. Tripett, p. 1459. 

5. "On the average and scatter," J. C. Moroney, p. 1487. 

6. "Mathematics of a lady tasting tea," Sir Ronald A. Fisher, 

p. 1512. 

7. "The vice of gambling and the virtue of Insurance," 

George Bernard Shaw, p. 1524. 

[94] Preparation for Graduate Work in Statistics , 1971. CUPM, 
P. 0. Box 1024, Berkeley, California 94701. 
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[95] Review of th e Tni^Prnational Statistical Institute . 

(2 Oostduinlaan, The Hague, Netherlands). Vol. 39, 
Number 3 (1971). The following articles: 

1. "New techniques of statistical teaching: Opening remarks," 
pp. 253-256. 

2 "The first course in statistical methods and the use of 
' teaching aids," K. Austwick, J. Hine, G. B. WetheriU, 
pp. 287-306. 

3. "Post college continuing education activities in 
statistics," J. Stuart Hunter, pp. 307-311. 

4 "Comments about a general audience TV course on 

statistics," J. Hemelrijk, pp. 312-314. 

5 "The joint American Statistical Association-National 

Council of Teachers of Mathematics Committee on the 
Curriculum in Statistics and Probability," F. Hosteller, 
pp. 340-342. 

6. "Operation of the Centre for Applied Statistics in 

Medicine and Medical Biology," D. Schwarz, pp. 346-347. 

7. "The teaching of statistics," T. Yoshizawa, pp. 348-350. 

8. "New techniques of statistical teaching," H. C. Hamaker, 

pp. 351-360. 

9. "The Jackknife," F. MosteUer, pp. 363-368. 

10. "Round table meeting: Recommendations," pp. 369-372. 

[96] ThP American S.:;. tis tician . 805 15 th S tree t , N W. , Wash ingt on , 
20005. "The Teacher's Corner" frequently contains 
articles on topics suitable for an introductory statistics 



course . 



[97] The Statistician . 55 Park Lane, London, W 1, England. See 
Vol. 18, Number 3, 1968: 

The Teaching of Statistics 

1. "Innovation in teaching," D. T. Page. p. 207. 

2 "Teaching management statistics by programmed instruction," 
D. Kitchen, pp. 209-226. 

3. "Practical classes in statistics," H. M. Davies, pp. 227- 
236. 




[98] Varberg, Dale E, *'The development of modern statistics," 
The Mathematics Teacher . Part 1, LVI (1963), pp. 252-257; 
Part 2, LVI (1963), pp. 344-348. 
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